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^  ABSTRACT 

Imagine  a  signal  acquisition  system  composed  of  a 
number  of  receivers  or  sensors  concurrently  scanning  the 
same  domain  for  signals.   It  is  reasonable  to  expect  that 
different  signals  will  each  be  detected  by  a  different 
subset  of  receivers  over  the  scanning  period.   Using  the 
data  collected  from  the  receivers,  it  is  possible  to  es- 
timate the  total  signal  population  size  including  those 
signals  not  detected  by  any  receiver.   Additionally,  it 
is  possible  to  estimate  the  probability  each  individual 
receiver  detects  signals.   Several  estimators  are  devel- 
oped for  these  quantities  in  the  context  of  a  model 
designed  to  represent  the  signal  detection  process.   This 
model  forms  the  basis  for  a  simulation  conducted  to  analyze 
the  behavior  of  the  estimators  over  a  variety  of  conditions 
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I.   INTRODUCTION 

Imagine  transmission  devices  emitting  signals  in  the 
electromagnetic  spectrum  at  unknown  times  and  of  unknown 
quantity.   Further,  imagine  there  are  receivers  concur- 
rently scanning  the  spectrum  in  an  effort  to  detect  the 
transmissions.   Suppose  there  are  k  receivers  in  the  sys- 
tem and  a  record  is  kept  of  each  signal  detected  by  each 
receiver.   It  is  reasonable  to  expect  that  some  signals 
will  be  detected  by  only  one  receiver,  some  by  more  than 
one  receiver,  and  some  signals  will  not  be  detected  at 
all.   Assume  each  signal  is  identifiable  by  its  charac- 
teristics making  it  possible  to  determine  whether  detec- 
tions by  several  receivers  were  actually  detections  of  a 
common  signal.   The  purpose  of  this  thesis  is  to  demon- 
strate how  data  collected  by  the  acquisition  system  can 
be  used  to  estimate  the  total  number  of  signals  exposed 
to  the  system  including  the  number  of  signals  not  de- 
tected by  any  receiver.   It  would,  additionally,  be 
interesting  to  know  the  probability  each  receiver  in  the 
system  detects  signals,  and  this  problem  will  also  be 
discussed. 

It  would  stand  to  reason  that  the  detection  process 
is  some  function  of  the  receiver's  capability  to  detect  a 
signal  as  well  as  the  signal's  ability  to  be  detected. 
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One  such  functional  relationship  (see  Barr  [Ref.  1]  )  will 
be  proposed  in  the  context  of  a  model  developed  to  repre- 
sent the  signal  detection  process.   Various  estimation 
principles  such  as  maximum  likelihood,  method  of  moments, 
and  least  squares  will  be  used  to  develop  estimators  for 
the  total  signal  population  size  and  the  receiver  intercept 
probabilities . 

A  development  of  several  estimators  will  be  shown  in 
detail  and  their  applicability  to  this  problem  discussed. 
These  estimation  procedures  will  then  be  incorporated  into 
a  general  model  constructed  to  represent  the  detection 
process.   This  model  supports  the  conduct  of  a  computer 
simulation  which  also  includes  the  generation  of  signals 
with  varying  signal  strength  and  simulates  detections  of 
the  signals  by  the  receiver  system.   The  resulting  esti- 
mates are  compared  to  the  actual  number  of  signals  gener- 
ated and  the  expected  receiver  intercept  probabilities  to 
provide  some  insight  on  the  quality  of  the  estimators. 
The  estimators  are  exposed  to  various  conditions  of  the 
signal  process  and  their  behavior  analyzed. 


'  II.   GENERAL  MODEL 

In  a  statistical  approach  to  modelling  the  physical 
phenomenon  of  signal  detection,  it  is  desirable  to  develop 
a  model  of  sufficient  generality  such  that  the  factors 
associated  with  radio  and  radiowave  theory  can  be  broadly 
parameterized.   This  generality  has  a  distinct  advantage  in 
that  it  is  not  necessary  to  precisely  define  what  type  of 
sensor  is  being  used  nor  what  necessarily  constitutes  a 
signal.   A  detection  is  presumed  to  be  some  interception 
of  a  signal  by  a  sensor  which  enables  the  signal  to  be 
identified.   It  may  be  that  a  signal,  once  detected,  is 
lost  and  then  redetected.   This  model  similarly  presumes 
that  a  reoccurence  of  a  signal  may  also  be  identified.   It 
is  also  desirable  to  prescribe  a  uniform  method  for  counting 
or  indexing  detections  in  a  manner  which  is  conveniently 
applied  to  mathematical  formulae  and  computer  code. 

A.   SIGNAL  DETECTION 

It  is  possible  to  postulate  functional  values  for  the 
probabilities  of  signal  detection  letting  tT-  •  be  defined  to 
be  the  probability  that  receiver  i  detects  signal  j ,  inde- 
pendent of  other  signals.   Each  receiver  or  sensor,  regard- 
less of  similarities  to  one  another,  will  be  peculiar  in 
its  relative  ability  to  detect  a  given  signal.   Each  signal 
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j  has  certain  characteristics  such  as  intensity  or  fre- 
quency which  affect  its  ability  to  be  detected.   (Depending 
on  the  circumstances,  a  signal  may  have  a  variety  of 
identifiable  characteristics.   For  the  purpose  of  this  re- 
port, these  characteristics  are  considered  to  be  aggregated 
and  called  the  "strength"  of  the  signal.)   Let  the  random 
variable  V  be  defined  as  some  measure  of  these  character- 
istics where  0<V<1.   Let  T.  (V)  represent  a  specific 
function  that  receiver  i  is  "able"  to  detect  a  random  sig- 
nal.  Thus,  a  general  expression,  r^.  .    =  T.  (v.),  relates 
the  ability  of  receiver  i  to  detect  a  signal,  to  the  ability 
of  signal  j  to  be  detected.   For  any  future  random  signal 
V,  Tti  =  T^(V)  . 

The  form  of  the  function  considered  in  this  model  is 

TT-  =  T .  (V)  =1.  •  V,  where  1.  denotes  the  proportion  of 
111'        1  '^   - 

signals  of  strength  V  that  receiver  i  would  detect.   It  is 

easily  seen  that  if  all  signals  were  certainly  detectable, 

V  would  take  on  the  value  one  and  T. (v)  =1..   Similarly, 

if  all  receivers  were  of  equal  specification  and  certainly 

able  to  detect  a  given  signal  for  any  v,  1.  =1  and 

T.  (v)  =  V  for  all  i.   Various  conditions  on  1.  and  distrib- 
1  1 

utions  for  V  will  be  considered. 

B.   METHOD  OF  INDEXING 

Consider  that  over  some  specified  time,  s  (unknown) 
signals  will  be  scanned  by  k  receivers  in  a  signal  intercept 


1:1 


system.   For  any  given  signal,  define  the  random  variable  Z 

to  be  a  k-component  vector  whose  components  consist  of 

z.  =  0  if  receiver  i  did  not  detect  the  signal  and  z.  =  1 

if  receiver  i  did  detect  the  signal.   Thus,  Z.  is  a  Bernoulli 

random  variable.   Let  S  denote  the  sample  space  of  Z,  so  S 

contains  2   k-dimensional  vectors  of  zeros  and  ones.   This 

naturally  includes  the  zero  vector  which  contains  the  un- 

observable  outcome  that  no  receiver  detected  the  signal. 

Over  some  specified  amount  of  time,  for  each  ztS,  let 

n   denote  the  number  of  times  that  outcome  Z  =  z  occurs  and 
z 

]^ 

let  n  be  a  2  -dimensional  vector  whose  components  are  the 

n  's.   For  example,  in  a  k  =  2  receiver  system,  S  =  {(0,0), 

(1,0),  (0,1),  (1,1)}  .   The  first  element,  the  zero  vector 

is  an  unobserved  signal.   The  second  element  represents  a 

signal  detected  by  receiver  1  only,  the  third  by  receiver  2 

only,  and  the  last  represents  a  signal  detected  by  both 

receivers.   Any  given  detected  signal  will  appear  as  an 

outcome  on  ZeS.   Over  many  signals,  n  _,^  ^.     is  the  number 

of  times  that  receiver  1  only  detected  the  signals.   The 

sum  over  all  n  will  be  the  total  number  of  signals  detected 

by  the  acquisition  system.   Because  ^  _,-^  ..  is  the  number 

of  signals  not  detected,  Z  /q  n  ss,  where  s  was  the  total 

unknown  number  of  signals  present.   Let  N  be  the  random 

vector  with  outcome  n.   It  follows  that  N  is  distributed 

according  to  the  multinomial  law,  N  >^  M   ,  (s,p),  where  p 

2^ 
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k 
is  the  2  -dimensional  vector  denoting  the  probabilities 

that  a  type  z  outcome  occurs . 
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III.   ESTIMATION  PROCEDURES 

Several  procedures  are  considered  for  estimating  the 
total  number  of  signals  which  pass  through  an  acquisition 
system.   Estimators  for  receiver  intercept  probabilities 
are  developed  for  each  approach.   The  maximum  likelihood 
approach  uses  the  properties  of  the  multinomial  distribu- 
tion in  conjunction  with  numerical  methods  for  maximizing 
the  likelihood  function.   A  method  of  moments  procedure  is 
developed  which  finds  a  solution  vector  to  a  set  of  simul- 
taneous equations  based  on  the  binomial  characteristics  of 
each  receiver.   Finally,  a  least  squares  approach,  again 
with  numerical  methods,  minimizes  the  square  error  between 
actual  and  expected  detection  outcomes  for  find  estimates 
of  signal  population  size  and  receiver  intercept 
probabilities. 

A.   MAXIMUM  LIKELIHOOD/CONDITIONAL  MAXIMUM  LIKELIHOOD 

The  concept  behind  this  procedure  is  one  of  estimating 
the  size  of  a  multinomial  population  with  incomplete  obser- 
vations.  This  technique  follows  an  approach  discussed  by 
Sanathanan  !Kef.  2]  .   It  is  convenient,  in  the  statistical 
sense,  to  imagine  a  set  of  cells  representing  the  2 
elements  in  the  sample  space  S  described  in  section  II.   A 
detection  by  some  subset  of  sensors  in  the  k-receiver  system 
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adds  a  count  of  one  to  the  appropriate  cell.   Recall  that 
after  many  signals,  the  total  counts  in  each  cell  will  com- 
prise  the  2  -dimensional  vector  N.   N  is  distributed 


multinomial , 


N/NiM  ,  (s,p) 
2^ 


Suppose  the  ordering  within  the  vector  N  is  such  that  the 
number  of  signals  which  missed  detection  is  placed  cell  n 

and  has  probability  p  .   Let  r  denote  the  number  of  remain- 

k  ^~r 

ing  cells,  r  =  2  -1.   Define  t  =  2_._^  n.,  thus  n   =  s-t. 

The  observation  of  (n^,...,n  )  yields  the  likelihood  func- 
tion L, 

^1        '^r      -t 
L(s,p)  =  sj (p.)   .  .  .  (p„)   (p_)  ~  . 

n^  :.  .  .n^:  (s-t)  !  "^     ° 

L(s,p)  may  also  be  written  as  the  product 
L(s,p)  =  L^  (s,p)L2  Cp) 


where 


L.  (s,p)  =    s:    (1-p^)  (p^' 
^        t!(s-t)l     °    ° 


s-t 


n^       n 
(1)     L2(p)         t!     (q.,)   ...Cq^)  ^ 

n^ I . . .n  I 


with 


^i  ^  Pi^^''"Po^  '  ^  ^  1  ,  .  .  .  ,r. 


L^  is  the  likelihood  based  on  the  probability  of  t  and  hence 
L^  is  the  likelihood  based  on  the  conditional  probability 
of  (n^,...,n  )  given  t.   The  following  lemma  is  known  (.see 
e.g.  Chapman  (1951 )) . 
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LEMMA:   For  any  given  p,  s  =  (t/(1-p  ))  (greatest  integer 

(t/1-p  ))  maximizes  L^(s,p  ),  where  L^(s,p  )  is 

defined  above.   If  1 -^^  =  t/s '  for  some  integer 

s',  then  §  and  s-1  both  maximize  L.(s,p  ).   Other- 
'  1    ^  o 

wise,  t  is  the  unique  maximum. 
Since  ^I"^.^  p.  =  1,  the  sum  over  p.,  i  =  1  ,  .  .  .  ,r  will 
uniquely  specify  p  .   Hence,  to  find  an  estimate  of  s,  it 
is  only  necessary  to  maximize  the  conditional  likelihood 
function  L^ (p) .   More  conveniently,  the  maximum  of  the 
log-likelihood  function  is  found.   Equation  (1)  may  be 
transformed  as  follows: 

(2)    log(L2(p))  =  log(K)  +  n^log(q^)  +...+  n^log(q^), 
where  K  =  1 1 /  (n^ ! . . .n  I )  . 
Equation  (2)  can  be  rewritten  as 

log(L2(p))  =  log(K)  +  Z^^^  m^log(rf^)  + 

^i=1  (t-m^)log(l-  n^)  - 

k 
(s-t)log(l-(l-rn'^  n^)), 

where  m.  denotes  the  sum  of  cell  counts  in  S  for  which 

1 

receiver  i  had  detections  Ci.e.  receiver  i  only  detected, 
receiver  i  and  receiver  j  both  detected,  etc.)  and  t-m. 
represents  the  number  of  non-detects  by  receiver  i.   Thus, 
it  is  possible  to  solve  directly  for  estimates  of  the 
receiver  intercept  probabilities,  r|_,  without  solving  for 
the  2   components  of  p. 

Since  K  does  not  depend  on  p,  it  is  not  necessary  to 
include  log(K)  when  maximizing  (.2).   Given  that  each  value 
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of  n.  ,  It^O  is  observable,  it  is  possible  using  a  numerical 
method  such  as  the  generalized  reduced  gradient  to  maximize 

the  function  for  optimal  values  of  rf-  •   The  value  for  p 

k 

is  clearly  "^     =    TL(1-n'.  )  and  from  the  lemma,  's  =  t/ ( 1 -^  ). 
"^  '^o    1=  I     1  o 

B.   METHOD  OF  MOMENTS 

As  previously  defined,  m.  denotes  the  total  number  of 

detections  made  by  receiver  i.   Since  each  detection  can  be 

considered  a  Bernoulli  trial,  the  random  variable  M.  is 

1 

distributed  Binomial  (s  ,  Tf.  )  .   For  a  k-receiver  system 


m^ 

= 

t 

^1 

m^ 

• 

= 

t 

^2 

• 

= 

^ 

\    ■ 

The  parameters  s  and  ft.  are  all  unknown,  hence  k  +  1  un- 

st 
knowns  exist  in  the  above  k  equations.   To  obtain  a  k  +  1 

equation,  consider  all  the  signals  which  were  detected  by 

two  or  more  receivers  in  the  system.   Define 


* 

m 


=  Z.  ■  •  (number  of  signals  detected 
*^-^    simultaneously  by  re- 
ceivers i  and  j )  . 

If  independence  between  receivers  is  assumed 

E(m*)  =  s  H.  .  Tf.  TT. 

KJ        1   3 

=  s  r.^.  (m.m./s^) 

^    T 

=   —   z_  .  .  m .  m , 

s    i<3   1  3 

The  estimators  for  s  and  rf.  thus  become  t  =  ( Z^ .  .  m.m.)/m* 

and  fl.  =  m.  m*/II.  .  m.m.. 
1    1     i<3      1  J 
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C.   LEAST  SQUARES 

Define  A  to  be  the  event  that  one  or  more  receivers 
detect  a  given  signal.   Hence,  P (A)  is  the  probability  that 
the  acquisition  system  will  successfully  intercept  any  given 
signal.   Now,  m.  is  defined  to  be  the  number  of  events  for 
which  receiver  i  had  detections,  and  t,  the  total  number  of 
detections  by  the  system.   Following  a  procedure  developed 
by  Knorr  [Ref.  3]  ,  it  is  possible  to  postulate  an  estimator 

for  Tf.  as  follows: 

1 

(3)  ff^  =  (m^/t)  •  P(A)  . 

In  this  expression,  m./t  denotes  the  proportion  of  signals 
detected  which  were  observed  by  receiver  i. 

Define  z^  to  be  the  number  of  receivers  which  detect  a 
signal, 

z  =    T.  .    .    z .  Os.  z  sk  . 

1=1   1 

A  value  for  z,  can  be  assigned  for  each  signal  intercepted. 

Further,  let  I-^  represent  the  number  of  occasions  where 

z.  =  j,  and  let  P   be  the  mass  function  for  z   .   It  fol- 

z  • 

lows  that  P   (j)  will  be  the  probability  that  exactly  j  re- 

ceivers  will  detect  a  given  signal.   A  possible  estimator 

for  P    is 
z 

(4)  ^   (j)  =  dVt)  •  '^(A)  . 


Note  that  for  j  =  0 , 


^2  (0)  =  1  -  ^(A)  . 
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Both  estimators  for  rf.  and  P   (j)  rely  on  estimating 

1        2  ^ 

the  value  of  P (A)  ,  where  0  <  P (A) <  1 .   By  setting  a  value  to 
P (A) ,  say  '^(A) ,  and  given  values  for  m.,  I  ,  and  t,  one  can 
find  p   (j)  as  a  function  of  ^(A) ,  using  (4) .   Using  the 
same  value  for  P(A),  one  can  similarly  compute  rr.  using  (3) 
It  is  possible  to  find  a  similar  value  for  P   (j),  denoted 
as  P   (j)f  by  making  use  of  its  functional  relationship  to 
Tf.  .   Knorr  suggests  the  following  algorithm  to  compute 

P,  (j): 

1.  Calculate  q.  =  It./d  -  r^-) 

^1     1       1 

k 

2.  Expand   TL  (x  +  q.)  to  obtain  the  polynomial 

k  ^    k-1  ^ 
ax  4-a^x    +...+a, 
o      1  k 

3.  Calculate  P   (j)  =  a  /Y.^   ^   a,  . 

z ,  n    ]  =  0   k 

Now  form  the  square  error  of  P (A) ,  where 

(5)        e2(P(A))  =  Zj^q(^2  ^^^  "  "^z  ^^^^^• 
By  varying  P (A)  over  its  range,  it  is  possible  to  find  a 
"least  squares"  estimate,  0^^(A)^-1,  which  minimizes  the 
above  expression.   Using  P'(A)  ,  tt.  can  be  found  using  (3). 
The  total  signal  population  size  passing  through  the 
acquisition  system  is  estimated  by  s  =  t/l^  (A)  . 
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IV.   THE  SIMULATION 

Three  methods  have  been  discussed  which  provide  esti- 
mators for  determining  receiver  intercept  probabilities. 
Similarly,  estimators  are  found  for  the  total  number  of 
signals  passing  through  an  acquisition  system  given  only  a 
portion  of  the  signals  were  detected.   In  this  section,  the 
techniques  used  to  test  each  method  will  be  discussed. 

The  three  methods  of  analysis  were  used  as  the  basis  for 
a  model  developed  to  support  a  computer  simulation.   The 
model  was  designed  to  perform  two  major  functions  necessary 
for  the  simulation.   The  first  function  is  to  generate  sig- 
nals simulating  the  transmission  of  signals  from  some  source 
The  second  function  of  the  model  is  to  statistically  relate 
each  signal  to  each  receiver  to  determine  actual  detections. 
During  the  simulation,  each  receiver  must  either  detect  or 
not  detect  a  given  signal.   Thus,  an  accounting  procedure 
was  developed  relating  each  receiver  to  each  signal.   Fi- 
nally, the  model  applies  each  method  of  analysis  to  the  data 
generated  and  estimated  values  of  intercept  probabilities, 
TT .  ,  and  total  signals,  's ,    are  compared  to  the  E  ( 'TT.  )  ,  and 
the  number  of  signals  specified  to  the  signal  generator. 

The  simulation  is  performed  in  two  parts.  The  first 
consists  of  one  replication  of  each  method  in  each  of  72 
different  situations.   A  situation  or  environment  is 
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comprised  by  varying 

1.  ..The  total  number  of  signals  generated. 

2.  The  number  of  receivers  in  the  acquisition  system. 

3.  The  parameters  specifying  the  relative  "ability" 
of  a  receiver  to  detect  a  signal. 

4.  A  parameter  specifying  the  relative  "ability"  of  a 
signal  to  be  detected. 

The  second  part  of  the  simulation  replicates  twelve  of  the 

above  environments  100  times  each,  thus  enabling  an  analysis 

of  mean  absolute  error,  bias,  and  variance  of  the  estimators. 

A.  INPUT:   "MAIN  ROUTINE" 

The  main  routine  reads  all  required  data  and  subsequently 
calls  each  subroutine  in  sequence.   Input  requirements  for 
the  simulation  include  the  random  number  generator  seed,  the 
number  of  signals  to  be  generated,  the  number  of  receivers 
in  the  system,  each  receiver's  ability  to  detect  a  signal 
of  strength  V,  the  parameter  specifying  the  "ability"  of  a 
signal  to  be  detected,  and  the  method  of  analysis  to  be 
used. 

Various  loops  in  the  main  routine  can  be  established  to 
test  one  or  more  methods  on  many  data  sets  (environments) 
or  to  replicate  over  one  data  set. 

B.  SIGNAL  GENERATION:   "SUBROUTINE  GNRATE" 

Recall  that  T.(V)  represents  the  specific  function  that 
receiver  i  is  able  to  detect  a  random  signal  and  that  the 
form  of  the  function  used  (see  II.  A.)  in  this  model  is 


21 


(6)  T^(V)  =  1^  •  V  . 

In  the  simulation,  1.  is  a  user  input  denoting  elements  of 
the  probability  vector  specifying  the  ability  of  receiver  i 
to  detect  any  given  signal.   Now,  suppose  V  is  a  Beta(«<,1) 
random  variate  denoting  the  ability  of  a  signal  to  be  de- 
tected.  The  Beta  distribution  was  selected  due  to  its  ease 
and  simplicity  of  generation  and  its  desirable  behavior  as 
alpha  is  allowed  to  vary.   All  outcomes  on  V  are  on  the 
range  (0,1)  and  can  be  envisioned,  under  certain  conditions, 
to  be  the  "probability"  that  a  random  signal  v  is  "detect- 
able".  Furthermore,  it  is  possible  to  imagine  a  case  where 
V  is  degenerate  at  1  denoting  that  signal  v  is  certainly 
detectable.   Clearly,  when  «  =  1 ,  v  becomes  a  uniform(0,1) 
outcome.   This  implies  that  the  "ability"  of  signal  j  to 
be  detected  is  random  with  an  equal  likelihood  of  being 
undetectable  as  detectable.   Thus,  by  varying  the  <*  param- 
eter of  a  Beta(<x,1)  random  variable,  it  is  possible  to 
specify  to  what  degree  each  signal  is  expected  to  be  "de- 
tectable" . 

For  integer   ex < 1  and  ^=1,  the  Beta  distribution  has 
the  following  cdf: 

F  Cv|  ot ,  1 )  =  v*^ ,  0  <  V  <c  1  . 

Since  all  values  of  v**  lie  on  the  interval  CO ,  1 )  ,  it  is  a 
simple  matter  to  generate  random  Beta  («=<,1)  variates  using 
the  probability  integral  transform  of  V  /v.  U.   Let  U  be  a 
uniform(0,1)  random  variable  and  V  an  outcome  on  U. 
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Then,  ^ 

V   =  U 

and     '  V  =  u''^'* 

Because  the  lim  u  '^  -♦I  ,  for  a  sufficiently  large   ,  the 

Oi.-*  CO 

Beta  (oc ,  1 )  distribution  can,  in  general,  be  used  to  repre- 
sent the  case  where  tt.  =  1..   An  cx  value  of  100  was 
selected  to  simulate  a  signal  which  is  virtually  certain 
to  be  detectable.   An  intermediate  case  of  oc  =  10  is  also 
tested. 

Each  signal  v.  is  therefore  defined  to  be  an  outcome  on 
v..   In  the  physical  sense,  «  =  1  represents  a  system  where 
all  receivers,  in  some  way,  act  alike  or  show  dependency. 
For  example,  if  an  outcome  on  V'^'lKO,!)  is  a  low  value, 
nearly  all  the  receivers  in  the  system,  regardless  of  their 
ability  to  detect  the  signal,  will  be  restricted  from 
doing  so  simply  because  the  signal  is  not  readily  detect- 
able.  Any  outcome  on  V  has  this  affect  on  the  entire  sys- 
tem, thus  causing  the  receivers  to  show  interdependence. 
On  the  other  hand,  if  V  is  degenerate  at  1  (simulated  by  a 
large  alpha  value) ,  the  detection  of  the  signal  is  based 
solely  on  the  characteristics  of  the  receiver.   In  this 
manner,  the  receivers  tend  to  act  independently  of  one 
another.   Hence,  changes  in  alpha,  in  a  restricted  sense, 
give  some  indication  of  correlation  through  receivers.   The 
case  where  o<  =  1 0  demonstrates  an  intermediate  degree  of 
dependence  between  receivers. 
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In  this  model,  each  signal  v  is  scanned  by  each  receiver. 
As  previously  mentioned,  a  function  of  the  model  is  to 
statistically  relate  each  receiver  to  each  signal  to  deter- 
mine actual  detections.   T.(v)  is  computed  for  each  receiver 
using  (6)  and  represents  the  probability  that  receiver  i 
detects  signal  j.   To  determine  if  the  detection  occurred, 
T. (v)  is  compared  against  a  uniform(0,1)  random  number, 
where  if 

U(0,1)   T.  ^  detection  occurs 

1 

U(0,1)   T.  :=»•  no  detection  occurs. 
Recall  that  Z  is  a  k-component  vector  of  zeros  and  ones 
denoting  which  receivers  did  or  did  not  detect  a  given 
signal.   Hence,  Z  =  z  is  an  outcome  on  the  k  comparisons 
above,  and  becomes  the  element  in  the  sample  space  S  which 
specifies  which  combination  of  receivers  detected  the 
signal. 

C.   COUNTING:   "SUBROUTINE  COUNT" 

The  estimators  developed  in  section  III  rely  on  certain 
"counts"  of  events  related  in  various  fashions  to  the  re- 
ceiver system.   Subroutine  COUNT  takes  the  data  created  by 
the  signal  generator  and  performs  the  necessary  accounting. 

Subroutine  GNRATE  passes  the  vector  N  to  subroutine  COUNT. 

]^ 

(N  is  the  2  -dimensional  vector  containing  elements  n  ,  n 

^  z    z 

being  the  number  of  times,  out  of  s  trials,  that  z,  zeg, 
occurs. ) 


24 


Let  B  denote  an  index  of  the  elements  in  the  vector  N. 
Suppose  ,B  =  4  represents  both  receivers  1  and  2  detecting 
a  common  signal,  and  over  many  signals  this  combination 
occurs  twelve  times.   This  event  is  then  annotated  as 
N(4)  =  12.   Note  that  N(1)  is  the  zero  vector  and  cannot 
be  observed.   A  convenient  method  of  arranging   B  is  to 
consider  the  binary  number  system.   Figure  1  demonstrates 
how  the  binary  numbers  can  be  used  to  order  B  for  a 
4-receiver  system.   For  example,  if  receivers  ^,    2,    and  3 
all  detect  a  common  signal,  this  is  associated  with  the 
binary  number  0  111  and  the  related  value  of  B  is  the 
base  ten  equivalent,  7.   B  relates  directly  to  the  random 
vector  Z.   By  computing  a  value  for  B,  Z  can  be  obtained 
simply  by  computing  the  binary  equivalent  of  B.   One 
convenient  algorithm  for  computing  an  outcome  on  Z  is  as 
follows : 

1 .  Let  B  =  1 

2.  Draw  a  U (0 , 1 )  random  number 

3.  If  U{0,1)<T.,  let  B  =  B  +  2^^"''^ 

4.  If  i^k,  go  to  2  and  repeat 

5.  Let  z  =  base2B, 

Using  Figure  1  as  a  reference,  it  can  easily  be  shown 
how  the  necessary  counting  is  performed.  Notice  that  the 
array  of  binary  numbers  is  actually  a  reflection  of  the  way 

each  receiver  is  listed  by  the  index.   By  considering  the 

k 
binary  array  to  be  a  (.2   X  k)  matrix,  various  row  and  column 

sums  can  be  used  as  multipliers  in  the  counting  procedure. 
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N(  B) 
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1    2 

i/ 
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0 

0 

0 

0 

0 

N(  2) 

1 

0 

0 

0 
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2 

2 

0 

0 

0 

N(  4) 

3 

1    2 

0 

0 

N(  5) 

4 

3 

0 

1 

0 

0 

N(  6) 

5 

3 

0 

1 

0 

N(  7) 

6 

2 

3 

0 

1 

0 

N(  8) 

7 

1    2 

3 

0 

1 

N(  9) 

8 

4 

0 

0 

0 

N(10) 

9 

4 

0 

0 

NC11) 

10 

2 

4 

0 

0 

NCI  2) 

11 

1    2 

4 

0 

N(13) 

12 

3 

4 

1 

0 

0 

NC14) 

13 

3 

4 

1 

0 

N(15) 

14 

2 

3 

4 

1 

0 

N(16) 

15 

1    2 

3 

4 

1 

Figure  1 •   Binary  Counter  for  a  4-Receiver  System 


26 


The  total  number  of  signals  detected,  t,  is  the  sum 
over  elements  n^,...,n   in  the  vector  N.   The  number  of 
signals  detected  by  receiver  i,  m. ,  can  be  computed  by 
looking  in  the  appropriate  column  in  the  binary  matrix. 
Receiver  1  is  represented  in  the  array  by  the  far  right 
column.   The  value  for  m^  is  computed  by  summing  those 
elements  in  the  vector  N  for  which  a  1  appears  in  the  far 
right  column.   This  procedure  is  repeated  over  all  k 
columns. 

The  value  of  m*,  m*  =  5I-  .  (the  number  of  signals  de- 
tected by  receivers  i  and  j  simultaneously) ,  is  obtained 
by  summing  those  elements  in  N  which  contain  two  or  more 
ones  in  the  associated  binary  number.   Remember  in  com- 
puting m* ,  that  if,  for  example,  three  receivers  detect  a 
common  signal,  then  that  element  of  N  will  be  counted  three 
times.   Likewise,  in  a  four  receiver  detect,  that  element 
of  N  will  be  counted  six  times.   Hence,  depending  on  the 
number  of  ones  in  the  associated  binary  number,  there  is 
an  appropriate  multiplier  assigned  to  each  element  of  N. 

The  value  for  ZI .  .(m.m.)  is  the  sxim  over  the  totals 

i<:   1  J 

obtained  in  each  column,  done  for  all  i  <:  j . 

D.   COMPUTING  ESTIMATES:   "SUBROUTINE  SOLVE" 

Subroutine  COUNT  passes  all  the  necessary  accounting 
information  to  subroutine  SOLVE  which  performs  the  opera- 
tions and  optimizations  required  to  produce  estimates  of 
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TT.  and  s  as  discussed  in  section  III.   Using  the  input 
parameter  METHOD  in  the  main  routine,  it  is  possible  to 
specify  which  one  or  more  methods  to  be  used. 

1 .  Method  1 :   Maximum  Likelihood 

Maximum  likelihood  estimators  will  be  found  using 
numerical  methods  because  as  k  increases,  Lagrangian  and 
other  techniques  quickly  become  too  burdensome.   In  this 
simulation,  the  non-linear  maximization  approach  used  is 
the  Generalized  Reduced  Gradient  Technique  (see  Lasdon, 
[Ref .  4]  ) .   This  computer  method  is  available  in  most 
computer  libraries  and  is  easy  to  use. 

Library  routines  DATAIN,  GRG,  and  OUTRES  are  called  in 
sequence.   Routine  DATAIN  reads  all  necessary  data  while 
routine  GRG  performs  the  optimization.   It  is  necessary  for 
the  user  to  supply  a  subroutine  GCOMP  which  evaluates  con- 
straint and  objective  function  values  (see  Appendix  A) . 
Routine  OUTRES  provides  the  user  information  on  each  iter- 
ation of  the  maximization.   The  quantity  of  output  can  be 
varied  by  a  user  inputted  flag  in  DATAIN.   In  this  simula- 
tion, the  iterative  data  is  totally  suppressed. 

2.  Method  2:   Method  of  Moments 

This  method  is  perhaps  the  only  one  of  the  three 
discussed  which  can  be  computed  by  hand.   Estimates  for 
TT.  and  s  are  simple  functions  of  the  data  provided  by 
subroutine  COUNT  and  are  computed  as  discussed  in  section 
III. 
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3.   Method  3;   Least  Squares 

Again,  numerical  techniques  are  necessary  in 
solving  least  squares  estimators.   An  initial  value  of 
P (A)  =  .1  begins  the  least  squares  minimization.   The 
value  . 1  is  chosen  because  of  the  potential  presence  of 
trivial  solutions  when  the  system  intercept  probability 
falls  within  the  interval  [0 , . 1 )  (see  Knorr,  1979).   P CA) 
is  incremented  in  steps  of  .01  on  the  interval  [.1,1]  . 
For  each  value  of  P (A) ,  ^   (j)  is  computed  using  (4)  and 
P   (j)  is  numerically  evaluated  using  the  algorithm  on 
page  19.   The  value  of  P (A)  which  minimizes  the  least 
squares  expression  (5)  becomes  the  system  intercept  prob- 
ability and  is  used  to  compute  tT.  and  's. 

E.   OUTPUT:   "SUBROUTINE  OUTPUT" 

Two  forms  of  subroutine  OUTPUT  are  used  depending  on 
which  part  of  the  simulation  is  being  performed.   Recall 
that-  in  the  first  part  of  the  simulation,  72  environments 
were  examined  one  time  each  to  obtain  a  feel  for  the  be- 
havior of  the  estimators.   A  sample  listing  of  the  results 
is  shown  at  Figure  2. 

The  second  part  of  the  simulation  focuses  on  analyzing 
the  mean  absolute  error  (MAE) ,  bias  and  variance  of  the 
estimators  for  rr.  and  s.   Twelve  of  the  environments  were 
selected  for  analysis  and  replicated  100  times  each.   For 
each  replication,  the  MAE  of  the  element  in  the  vector  tT 
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was  computed  by  comparing  the  estimated  values  to  the 
expected  values  of  rf.   The  expected  value  of  Tf.  is  easily 
computed  given  1.,  the  specified  ability  of  receiver  i  to 
detect  a  signal  of  strength  V,  and  the  distribution  of  V. 
Given  that  the  form  of  the  function  for  n.    =  T. (V)  = 
1.  •  V,  E(Tt.  )  =  E(l.  •  V)  =1.  •  E(V).   The  expected 
value  of  a  Beta(«<,l)  random  variable  can  be  shown  to  be 
o*/(l+<^).   Hence,  E  (  Tf .  )  =1.  •  o^/(l+«).   The  MAE  of  the 
receiver  intercept  probability  becomes  ABS(Tt.  -  E  (  rf .  ) ) . 
The  MAE ' s  are  summed  across  the  entire  probability  vector 
to  produce  an  MAE  estimate  for  the  system.   The  100  system 
MAE  estimates  are  then  sectioned  into  ten  blocks  of  ten 
replications  each,  making  use  of  the  computer  library 
routine  SECTN.   In  this  manner,  estimated  sample  parameters 
on  the  system  MAE  (i.e.  mean,  variance,  etc.)  are  computed 
along  with  estimated  parameters  of  the  sample  parameters. 
Figure  3  shows  a  typical  output  listing  for  subroutine 
SECTN.   (Remember  that  these  sample  parameters  are  on  the 
estimate  of  the  MAE  for  TT,  not  on  the  estimate  of  n  di- 
rectly. ) 

Following  the  sample  parameters  is  a  listing  of  the 
initial  input  to  the  signal  generator.   Next,  the  method  of 
analysis  used  is  shown,  followed  by  direct  estimates  of  the 
mean  and  variance  for  each  element  in  ^. 

The  identical  procedure  is  followed  for  analyzing  the 
estimator  §.   A  typical  output  listing  for  the  analysis  on 
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s"  is  shown  at  Figure  4.   The  above  procedure  is  duplicated 
for  each  of  the  three  methods  discussed  in  section  III. 
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INPUT    PARAMETERS    TC    SIGNAL    GENERATOR 

^    NUMBER    OF    SIGNALS    GENERATED:  1000 

NUMBER    CF    RECEIVERS:  3 

ALFA    PARAMETER:  100.0 

RECEIVER    PRObAdlLlTY   VECTOR:  0.20    0,50   0.80 

CELL    CCLNTS 

N(  L)  =  22 

N(  2)  =  83 

NJ  3)  =  1^ 

Nj  ^)  =  312 

n(  5)  =  75 

M(  b)  =  324. 

N  {  7  )  =  86 

OPTIMIZATICN    CCEFFICIENTS 

OBSERVED    NUieER    OF    DETECTIONS    BY    RECIEVER    I: 

197.0         507.0         797.0 
OBSERVED    NUMBER    OF    rjO-DETECTS    BY    RECIEVER    I: 

719.0         '♦09.0  119.0 

OBSERVED    NUMBER    OF    TIMES    J    RECIEVERS    DETECTED    A    COMMON    SIGNAL: 

417.0         413.0  86.0 

NUMBER    OF    SIGNALS    INTERCEPTED:  916.0 

OPTIMIZATICN    METHOD:       MAXIMUM    LIKELIHOOD/CONDITIONAL    MAXIMUM    LIKELIHCOO 

ESII.MATES    OF    INTERCEPT    PROBABILITIES: 
0.20    0.51    0.80 

ESTIMATE    OF    THE    TOTAL    NUMBER    OF    TRANSMISSIONS:  992.79 

OPTIMIZATION    METHOD:       METHOD    OF    MOMENTS 

ESTIMATES    OF     INTERCEPT    PROBABILITIES: 
0.20    0.51    0.81 

ESTIMATE    OF    THE    TOTAL    NUMBER    OF    TRANSMISSIONS:  985.05 

OPTIMIZATICN    METHOD:       LEAST    SQUARES 

SYSTEM    INTERCEPT    PRCSABILITY:  0.92 

ESTIMATES    CF    INTERCEPT    PROBABILITIES: 
C.20    0.51    0.80 

ESTIMATE    CF    THE    TOTAL    NUMBER    OF    TRANSMISSIONS:  995.65  ' 


Figure  2.   Sample  Output  -  Form  1 
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"         V.   ANALYSIS  OF  RESULTS 

The  purpose  of  this  section  is  to  demonstrate  the 
results  of  the  simulation  described  in  section  IV  and  to 
discuss,  in  general  terms,  trends  and  observations  about 
the  behavior  of  the  different  methods  of  analysis  as  they 
apply  to  the  model.   The  first  part  of  the  simulation  used 
each  of  the  three  methods  in  72  different  environments  to 
obtain  estimates  of  the  total  signal  population  size.   In 
the  second  part  of  the  simulation,  twelve  environments  were 
replicated  100  times  each  and  mean  absolute  errors  (MAE) 
of  the  estimates  for  radio  intercept  probabilities,  fr- f 
and  total  signal  population  size,  s,  were  obtained.   The 
mean  and  variance  of  the  MAE  estimates  were  computed  over 
all  replications.   Additionally,  the  mean  and  variance  of 
the  estimators  themselves  were  computed. 

The  data  shown  in  Table  1  and  Table  2  summarize  the 
results  obtained  in  the  first  part  of  the  simulation.   In 
Table  1  are  the  estimates  of  signals  generated  for  a  3- 
receiver  system  using  each  of  the  three  methods  of  analysis. 
The  input  values  for  the  radio  intercept  capabilities  and 
the  alpha  parameter  are  listed  in  the  first  column.   The 
actual  numbers  of  signals  generated  are  listed  in  the  second 
column  comprising  an  environment.   The  6-receiver  intercept 
systems  are  shown  in  Table  2.   In  the  6-receiver  environments, 
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two  receivers  share  a  coininon  value  for  1 .  ,  thus ,  a  vector 

of  .6/. 7/. 8  implies  that  two  receivers  were  specified  to 

have  1.  values  of  .6,  two  of  .7,  and  two  of  .8  . 
1 

This  part  of  the  simulation  was  designed  to  give  a 
feel  for  how  the  estimators  would  behave  over  a  wide 
range  of  conditions  and  to  help  select  an  interesting  set 
of  environments  from  which  to  analyze  in  more  detail.   Re- 
source limitations  precluded  a  complete  analysis  of  all 
environments.   Those  situations  indicated  with  an  (*)  are 
the  ones  selected  for  replication. 

Though  no  formal  claims  can  be  made  about  the  estimators 
in  the  first  stage  of  the  simulation,  a  review  of  the  data 
in  Tables  1  and  2  seems  to  indicate  that  all  the  methods 
perform  better  as  alpha  increases  (as  the  receivers  become 
less  dependent)  and  as  the  receiver  intercept  probabilities 
are  increased.   This  result  is  intuitively  appealing 
because  changes  in  the  parameters  which  increase  the  ability 
of  a  signal  to  be  detected  or  a  receiver  to  detect  a  signal 
will  result  in  an  increase  in  signals  detected.   As  a 
higher  portion  of  the  total  signals  are  detected,  more  data 
are  available  for  estimating  the  total  number  of  signals 
present. 

The  results  of  the  second  part  of  the  simulation  are 
shown  in  Tables  3-8.   Tables  3-5  show  mean  and  variance 
estimates  for  the  receiver  intercept  probabilities  for 
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alpha  equal  to  1 ,    10,  and  100  respectively.   Tables  6-8 
show  mean  and  variance  estimates  for  the  total  signal  popu- 
lation sizes.   Notice  that  all  mean  estimates  of  receiver 
intercept  probabilities  tend  to  be  positively  biased.   The 
bias  is  more  significant  for  alpha  equal  to  1  and  improves 
greatly  for  alpha  equal  to  10,  and  tends  to  become  nega- 
tively biased  for  alpha  equal  to  100.   Thus,  it  appears 
that  a  high  degree  of  dependence  between  receivers  will 
have  a  significant  impact  on  the  bias  of  the  estimators. 
Similar  trends  are  not  as  readily  apparent  on  mean  esti- 
mates of  population  size.   Though  maximum  likelihood  and 
method  of  moment  estimators  seem  to  be  negatively  biased, 
the  least  squares  estimator  shows  several  instances  of 
strong  positive  bias,  particularly  for  small  sample  size. 
One  possible  explanation  for  this  may  be  found  in  the  large 
variance  estimates  for  the  least  squares  estimators.   This 
may  be  an  indication  that  the  model  is  not  adequately  dis- 
tinguishing between  the  trivial  and  non-trivial  solutions 
for  P(A).   There  appears  to  be  consistently  much  better 
estimates  for  signal  population  size  as  alpha  increases. 

With  the  wide  variety  of  changing  parameters  and  rela- 
tively few  replicated  trials,  it  is  not  possible  to  make 
comparative  claims  between  the  estimators  under  changing 
conditions,  but  only  to  look  at  the  estimators  under  the 
conditions  tested.   However,  because  there  were  four 
environments  tested  for  each  value  of  alpha,  there  are  some 


37 


suggestions  about  the  quality  of  each  estimator  which  can 
be  made.   For  each  value  of  alpha,  the  sum  of  the  means 
and  variances  of  the  MAE  estimates  was  computed  over  all 
environments  tested  for  each  estimator.   These  sums  repre- 
sent a  score  for  each  estimator  over  various  conditions  but 
with  constant  alpha.   These  mean  absolute  error  scores  for 
estimates  of  radio  intercept  probabilities  and  total  signal 
population  size  are  shown  in  Table  9.   Notice  that  the 
method  of  moments  estimator  appears  to  perform  the  best  for 
estimates  of  1Y.  when  alpha  equals  10  and  100.   The  variances 
of  the  estimates  are,  however,  too  large  to  claim  it  is  the 
best  estimator.   This  table  does  show  that  there  is  a  sig- 
nificant reduction  in  error  as  receiver  dependence  decreases. 
No  one  estimator  appears  to  be  better  for  signal  population 
size  over  all  tested  values  of  alpha,  but  again,  the  esti- 
mators do  tend  to  improve  as  alpha  increases.   It  is  inter- 
esting to  note  that  maximum  likelihood  estimates  tend  to 
have  the  smallest  variability  while  the  least  squares  esti- 
mates have  the  largest. 

Ideally,  all  72  environments  should  be  replicated  and 
estimates  compared  over  all  conditions  to  obtain  performance 
criteria  on  each  estimator.   A  data  analysis  of  this  mag- 
nitude would  provide  valuable  insight  into  the  problem  but 
is  beyond  the  scope  of  this  thesis. 
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Input 

Signals 

Signals 

Maximum 

Method  of 

Least 

Values   Generated 

Detected 

Likelihood 

Moments 

Squares 

^,1. 

Estimates 

Estimates 

Estimates 

oC  =  1 

25 

13 

14.45 

13.46 

15.29 

.6/. 7/. 8 

100 

70 

82.78 

79.26 

85.37 

1000* 

650 

769.90 

734.99 

802.47 

10000 

6537 

7804.23 

7596.42 

7971 .95 

25 

7 

9.55 

10.67 

9.09 

.2/. 3/. 4 

100* 

40 

68.78 

64.36 

72.73 

1000 

378 

785.35 

771.09 

804.26 

10000 

3651 

7490.23 

7330.80 

7606.25 

25 

14 

17.56 

19.20 

16.67 

.2/. 5/. 8 

100 

54 

66.48 

64.57 

68.35 

1000 

547 

750.55 

759.06 

749.31 

10000 

5465 

7590.86 

7459.31 

7697.18 

oc  =  10 

25 

24 

26.58 

29.29 

26.67 

.6/. 7/. 8 

100 

98 

101.42 

100.26 

101.03 

1000 

955 

999.50 

997.43 

994.79 

10000* 

9522 

9951 .69 

9942.84 

9918.75 

25 

21 

27.76 

27.90 

27.63 

.2/. 3/. 4 

100 

62 

84.35 

81  .73 

86.11 

1000 

601 

982.82 

1007.44 

969.35 

10000 

6262 

10184.48 

10208.45 

10100.00 

25* 

19 

24.94 

23.63 

26.03 

.2/. 5/. 8 

100 

86 

99.18 

98.59 

100.00 

1000 

864 

990.72 

974.08 

1004.65 

10000 

8809 

10020.67 

10043.02 

10010.23 

oc  =  100 

25 

24 

24.79 

24.32 

24.74 

.6/. 7/. 8 

100 

98 

100.96 

100.97 

101.03 

1000 

980 

1004.61 

1009.47 

1010.31 

10000 

9720 

9988.40 

9973.44 

10020.62 

25* 

20 

42.46 

36.00 

51.28 

.2/. 3/. 4 

100 

61 

85.26 

90.56 

82.43 

1000 

651 

948.93 

950.72 

943.48 

10000 

6539 

9887.67 

9830.35 

9907.57 

25 

25 

27.40 

28.21 

26.88 

.2/. 5/. 8 

100 

93 

100.46 

99.64 

101.09 

1000* 

906 

995.26 

984.95 

1006.67 

10000 

9125 

9972.98 

9965.46 

10027.47 

Table  1 

•  Estimates  of  Sign 

als  Generate 

5d/3-Receiver  System 
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Input  Signals    Signals    Maximum   iMethod  of  Least 

Values  Generated   Detected   Likelihood   Moments  Squares 

oc  , 1 .  Estimates   Estimates  Estimates 

oc  =  1 


25*  19  19.40  18.74       19.59 

.6/. 7/. 8     100  72  73.95  69.83       76.60 

1000  773  803.01  716.65  831.18 

10000  7965  8248.49  7510.09  8384.21 

25  14  14.98  14.62       15.56 

.2/. 3/. 4     100  49  61.17  58.70       62.03 

1000  566  747.70  698.84  754.67 

10000  5614  7886.43  7512.48  7907.04 

25  17  20.02  21.25       19.54 

.2/. 5/. 8     100  70  75.01  74.83       76.92 

1000  719  796.05  751.39  798.89 

10000*  7344  8104.96  7606.72  8251.68 

oc  =  10 

25  25  25.04  24.87       25.00 

.6/. 7/. 8     100  100  100.23  99.54  100.00 

1000  996  997.79  993.13  996.00 

10000  9969  9989.28  9955.48  9969.00 

25  24  27.90  27.83       28.57 

.2/. 3/. 4     100*  91  104.85  105.35  105.81 

1000  844  977.51  978.60  981.40 

10000  8568  9958.32  9866.30  9962.79 

25  24  24.33  24.44       27.27 

.2/. 5/. 8     100  97  98.40  99.23       98.98 

1000*  990  1006.67  995.82  1010.20 

10000  9811  9956.08  9924.80  9910.10 

oc  =  100 

25  25  25.01  24.85       26.04 

.6/. 7/. 8     100*  99  99.07  97.91       99.00 

1000  998  998.94  997.17  998.00 

10000  9994  10000.83  9992.41  9994.00 

25  22  25.42  23.06       26.51 

.2/. 3/. 4     100  79  86.98  94.81       86.81 

1000  876  985.43  978.01  995.45 

10000*  8777  9807.58  9893.83  9973.86 

25  24  24.12  24.93       24.00 

.2/. 5/. 8     100  99  99.79  100.70  101.02 

1000  999  1006.50  1007.47  999.00 

10000  9926  10002.23  9976.55  9926.00 

Table  2   •  Estimates  of  Signals  Generated/6-Receiver  System 

(Two  receivers  share  a  common  intercept  probability) 

40 


(NJ 

(^ 

C\J 

CO 

>c> 

p^ 

00 

CO 

vl- 

< 

in 

a» 

00 

r- 

2: 

IT. 

• 

• 

• 

•-4 

• 

• 
00 

Ul 

LU 

UJ 

r- 

0^ 

CM 

vH 

>— • 

a:ooz 

fO 

<^ 

ro 

00 

H- 

<UJ 

i»— t 

CVJ 

r»- 

00 

00 

•— t 

^H-Z 

0 

<-4 

r-k 

(NJ 

-J 

ar< 

• 

• 

• 

• 

1-4 

OOZ 

colu 

l-H 

»0<NJO00 

vrsj->i->o 

^(NJOin-^inoo 

in  in  in  in  in  mm 

<Q. 

1— H-(X 

ror^osjin 

OOO'-^ 

oof^NOr-vOsor- 

1    1    1    1    1    1  0 

CD-. 

l/)00< 

00'^'-< 

0000 

(NirgromNTvi-O 

0000000 

OK- 

<UJ> 

0000 

0000 

000000  ro 

II    <i     \r-\>-^t     li     to 

QCZ 

LU 

•    •    •    • 

•  •  •  • 

• 

Q.UJ 

-J 

0 

z 

po-OCJ^fH 

0 

-^roin-< 

CNJO^-4-mOinrri 

0 

OincNjooincNj— < 

H-LU 

< 

0 

-^sOOnO 

0 

-tOOOO 

>OstaoOP~(T'in 

0 

fNj-^ininp*-coo 

(XX 

UJ 

0 

(Nir-in-^ 

0 

QOvtOOO 

in 

oor-m>^o^com 

0 

fNirgoooooom 

UJH- 

3: 

-^ 

•  •  •   • 

^^ 

•  •  •  • 

CNJ 

(NIcMrnrornroo^ 

^-4 

-^•Hrnro^>3-<^ 

0 

qcqc 

UUUJ 

•• 

.^ 

•  • 

in 

•• 

a* 

•• 

vO 

»-> 

X 

0 

in 

Q 

ro 

Q 

0 

Q 

r- 

ZO 

< 

LU 

m 

LU 

vO 

LU 

in 

LU 

ro 

1— • 

CO 

s: 

t- 

r^ 

1- 

>!■ 

1— 

• 

1- 

in 

Q 

K 

< 

• 

< 

• 

< 

r-l 

< 

• 

ccuj 

z 

CC 

QC 

QC 

QC 

UJK 

uu 

LU 

«r 

LU 

in 

LU 

tr 

LU 

>r 

>3 

zooz 

2 

r^ 

z 

CO 

z 

^O 

z 

0 

— .Q. 

Ouu 

II— 1 

LU 

0 

LU 

(NJ 

UJ 

in 

LU 

nO 

ujs: 

STKS: 

0 

0 

0 

(\J 

0 

(N 

0 

^ 

00 

< 

• 

• 

• 

• 

LUO 

LLZ 

00 

LD 

00 

00 

QC 

o-^ 

_l 

p>-(MOir\ 

^ 

msOin-^ 

_i 

rHor»in-4f>-(^ 

-J 

in  in  in  in  in  mm 

LU 

-^            H-a: 

< 

rOvOO^O 

< 

OOOCN) 

< 

Q0-O(Nf^or»m 

< 

1    1    1    1    1    1  0 

U_QC 

QoO< 

3 

OOOoj 

•z. 

0000 

z 

f^f— <>-^«    4i     >^^f«- 

z 

0000000 

a< 

II        auj> 

0 

0000 

0 

0000 

0 

0000000 

0 

P^  _4  r^  ^4  f-^  ^4  0 

X 

>—< 

•    •    •    • 

►— • 

•    •    •    • 

t-H 

•     •••••• 

1-4 

• 

00  to 

<          H- 

00 

00 

00 

00 

LULU 

UL            LU 

2: 

■4-^p^r^ 

Nj-sOinin 

^inrgooa^co-^f 

comm-Hmor*' 

1— 1— 

-J       z 

< 

LL 

0-«OnO 

u. 

o<omo 

U- 

—•c*in>oo^o^^ 

u. 

osimrommmco 

<< 

< 

LU 

0 

-tO^-rsJ 

0 

Ovomin 

0 

ooo>tinrnrgr-t 

0 

romm  rororoo 

s::r 

2 

^(^i(^lC^J 

>i->j-inm 

rnfOsj-Ni-ininoo 

<-H-4mmmm>i- 

.-xt— « 

a: 

•   •   •   • 

QC 

•  •  •  • 

QC 

QC 

f-i— 

LU 

LU 

LU 

LU 

0000 

OD 

CT^ 

CD 

^-k 

CQ 

in 

CS 

m 

LULU 

X 

s: 

m 

2: 

<) 

•SL 

^o 

2: 

a> 

a 

< 

rs 

(NJ 

3 

fvi 

3 

.-NJ 

3 

m 

^cn  — 

o 

2: 

2 

ITt 

Z 

•^ 

Z 

• 

Z 

>*■ 

00   • 

o 

• 

• 

f-4 

• 

QCa: 

X 

luqco 

►-.on 

1 

0 

f- 

fO 

m 

OLUt— 

-lujz: 

0 

in 

0 

0 

z    0 

LUI- 

'  t-^ 

rsj 

in 

l-t 

r^ 

<UJLU 

^<s 

ro 

0 

m 

•-4 

0 

<N 

>o 

(NJ 

•— >-> 

•-s: 

• 

• 

• 

• 

QCZ> 

-J»-H 

1 

<_J> 

1- 

•  • 

f^QOOO 

•  • 

roinofM 

•• 

>Of^>OfMin>o-t 

•  • 

(Mr-4l-(<N>J--.i-N0 

>Ol- 

Sooo: 

j/> 

(N^CO-< 

oo 

OOOCM 

00 

-^a»m  (Margin 

OO 

0000    1       1    '-• 

OO'-t 

:duj< 

a: 

000— 4 

q: 

0000 

QC 

— 4Q_l^^_<^^^ 

QC 

0000000 

QCD-J 

s 

> 

UJ 

0000 

LU 

0000 

LU 

0000000 

UJ 

0000-^-^0 

z<-. 

HM 

> 

•     •     •    • 

> 

•   •  •   • 

> 

•  •••••• 

> 

•     •      •     •                    • 

<       CO 

X 

►— « 

•—4 

t-M 

t-x 

z< 

< 

2 

LU 

r*-o^NO— < 

LU 

vOrvih-in 

LU 

vO<N-4"ino^o^fn 

LU 

rnmOvO^'^m 

Z<a3 

:?! 

< 

0 

iTiNj-miTi 

0 

O^i•0^^o 

0 

vOfO<NJinsOvJ-rO 

0 

rvjcNjm— *^mm 

<UJC 

UJ 

LU 

(NO'ino^ 

LU 

QOinFH—* 

LU 

co^^'-^rvivOOm 

LU 

.— if-4OOOOC0 

UJSaC 

z 

LL 

•   •  •   • 

a: 
u. 

fO'^-inm 
•  •  •  • 

QC 
U_ 

•    •••••• 

QC 
U- 

-4-^rominmm 

SIwQ. 

q: 

O 

0 

0 

0 

• 

LU 

QC 

.ai* 

«i» 

a» 

«» 

m 

>cQO 

C^ 

otnOLu 

QC 

oinouj 

CC 

ooinmooLU 

QC 

oommooLU 

»-iOH- 

LU 

-^"^rsK 

LU 

rnra>r< 

LU 

r'irnmrn>i-vr< 

LU 

-^-HfM<^J■^^^r< 

LU 

LUQlO 

CO 

•    •    'S 

CO 

•   •   .s 

CO 

2: 

CD 

2: 

_i 

OO.UJ 

S 

w 

SL 

.^ 

2: 

■w 

2: 

«^ 

CO 

LU 

> 

Z) 

3 

=) 

3 

< 

ac 

z 

Z 

Z 

Z 

e- 

41 


•1» 

rO 

0 

r- 

<t 

X 

(NJ 

m 

f^ 

0 

< 

(M 

m 

in 

m 

z 

• 
f-4 

c 
• 

• 

>— < 

• 

• 
00 

\n 

LU 

UJ 

■-• 

>*• 

m 

Ln 

►—1 

Qil/)^ 

sf 

0^ 

0 

0 

t- 

<UJ 

It— 1 

^d- 

0 

0 

m 

>"* 

=5»- 

;S 

0 

0 

-H 

0 

-J 

o< 

• 

• 

• 

• 

H^ 

oor 

COLU 

HH 

-^00^O>t 

in  in  in  »4- 

vO^— *lnln^o^- 

-<^ro<\lroc\jv}- 

<a: 

i-t-o: 

r-ir»^if\ 

1    1    1    1 

— 4i-t(Nj<N<^^>jf^ 

0000000 

CO'-' 

00t/)< 

OfMLnoN 

0000 

0000000 

OOOCOOO 

QH- 

<UJ> 

0000 

»-^i— <•— «■— < 

0000000 

0000000 

QCZ 

LU 

•  •  •  • 

Q.UJ 

—1 

0 

2 

in  f»- 00  in 

0 

v^QOvO^ 

a>roa»pi-(\i(Mro 

0 

r-crcof>^ir>vOrn 

H-LU 

< 

(VjO^OnO 

0 

o-^mo 

0 

rnror<iin>oroa3 

0 

O-^vf  ooo^oo 

ax 

LU 

in 

>OfOf»-fo 

0 

<r>jTO^ 

0 

aooo^»^-^o^o>*■ 

0 

coooinincMrnvO 

LUh- 

z 

(\j 

•   •   •  • 

f-4 

in>or*-o 
•  •  •  • 

«-4 

-^-^rvjcsicnforvj 

^^ 

— <-^>^>^r»r-o 

0 

qcqc 

LUUJ 

•  • 

>0 

•  • 

00 

•  • 

vO 

t» 

00 

l-> 

X 

Q 

ro 

0 

(M 

0 

0 

Q 

in 

zo 

< 

LU 

vO 

LU 

•d- 

LU 

in 

LU 

1— • 

»— • 

00 

z 

H 

in 

h- 

0 

H- 

>o 

h- 

1-^ 

Q 

>- 

< 

• 

< 

• 

< 

• 

< 

• 

QiLU 

z 

C£. 

QC 

QC 

QC 

LU>- 

LU 

UJ 

in 

UJ 

0 

LU 

rg 

LU 

f-i 

>0 

srooz 

Z 

ro 

z 

rg 

z 

fVJ 

2 

in 

►-.a 

Olu 

•— < 

LU 

•J- 

LU 

0 

LU 

-Q 

LU 

fO 

ms: 

STH- 

■3: 

0 

0 

0 

0 

0 

0 

0 

0 

00 

< 

• 

• 

• 

• 

LUO 

u_s: 

U1 

(/I 

00 

00 

QC 

O          O'-' 

_i 

0-^^(\J 

—J 

in  in  in  vt 

_J 

— •r-r~0"ino— < 

^ 

'-^— <(N(Nj<\jrjro 

LU 

-^                 h-OL 

< 

socvjcoin 

< 

1   1    1   1 

< 

rvj^(\i^^<\ifnoo 

< 

0000000 

LLQC 

Q00< 

Z 

O-^^-^-H 

z 

0000 

-^ 

0000000 

z 

0000000 

a< 

II         c;uj> 

0 

0000 

0 

m^r-*<-t—^ 

CJJ 

0000000 

0 

0000000 

X 

N-4 

•  •  •  • 

1*4 

>-4 

•  •••••• 

•— • 

•  •••••• 

0000 

<       t- 

00 

00 

00 

00 

LULU 

U_           UJ 

2 

or- >}•(*> 

^^0^^.4 

rOinroO^cOfNfO 

(7*  C7*  r— cNj  0  vO  ^» 

>-l- 

-J       s: 

< 

u. 

T^-*COO 

LL 

a^rgrooo 

LL 

fMin>o— <>t<7*u^ 

LU 

inrgooOvj-^^aO 

<< 

< 

UJ 

0 

r^in>i-in 

o 

N^Nj-ro— 1 

0 

cocor^r^sOvOfM 

a 

cocDinmrorOvO 

sTs: 

3: 

-^str-cN 

invor-o 

-Hr-tog<M(^rnc\i 

^-^^vj-r-r-o 

1-4  >— 4 

OC 

•  •  •  • 

QC 

•  •  •  • 

QC 

C£. 

V-(— 

LU 

LU 

LU 

LU 

0000 

CO 

in 

CO 

0 

CD 

in 

CO 

f— « 

LULU 

X 

s 

in 

S 

^^ 

S 

— « 

SL 

r-^ 

Q 

< 

=3 

(^ 

3 

>l- 

r) 

0 

Z> 

ro 

ZQC  — 

O 

z 

Z 

in 

Z 

0 

z 

-4- 

z 

-^ 

00    • 

O 

« 

• 

• 

• 

qcck: 

X 

UJQCO 

H-CO 

1 

cr 

•-* 

in 

<f 

OLUt- 

-JLUZ 

0 

rvi 

0 

cr 

z    0 

LUI- 

»— < 

-4- 

0 

<— 1 

ro 

<UJLU 

^<5: 

ro 

0 

rn 

0 

>o 

r-« 

vO 

0 

•-'>-> 

—s: 

• 

• 

• 

• 

QCZ5 

_J«-H 

1 

<_!> 

K 

•  • 

inrnop- 

•  • 

inuMn>i- 

•  • 

oor~NOinoNrovO 

•  • 

rsicMmnjrnrgin 

>o^- 

2:00  ex: 

00 

o-4-r-"^ 

00 

1    1    1   1 

00 

-H^(M(\j(M<NJvO 

00 

0000000 

00>-» 

3UJ< 

cc 

O^Hi— 4i-H 

a: 

ocoo 

QC 

0000000 

QC 

ocooooo 

QCD_J 

s: 

> 

UJ 

0000 

LU 

— ^1— (1— (t— t 

LU 

0000000 

LU 

0000000 

Z<'-' 

»»4 

> 

•    •    •    • 

> 

> 

•  •••••• 

> 

•  •••••• 

<      CO 

X 

»-4 

»_« 

1-4 

1-4 

z< 

< 

z 

LU 

(MO^fNJO 

LU 

(\jin>f  r<- 

UJ 

-rm<Nicooinf^ 

LU 

tMCOOO-^COO 

z<a3 

S 

< 

0 

otMcncNj 

0 

OOOO^ 

0 

(Mr-sO»OCOrf^r\j 

0 

(M^^OOO-H-^ 

<uJO 

UJ 

LU 

0^in>4-N0 

UJ 

vj-vi-m^ 

UJ 

QOoor-r-vO^rn 

LU 

oOvOinrjcNjoo 

ujSq: 

s 

U_ 

•  •  •  • 

oc: 

inoh-o 
•  •  •  • 

QC 
U. 

•  •••••• 

QC 
LL 

-^—^NJ-^J-P-f^O 

STwO. 

CC 

0 

a 

a 

a 

• 

UJ 

a: 

— » 

•^ 

•«* 

«» 

^ 

>cQO 

CC 

ooinf^LU 

q: 

in^rOLU 

CC 

cr>cof*-N-vO>OLU 

QC 

coooininrornuj 

i-iOl— 

UJ 

'HNrr-< 

LU 

invor*-*! 

LU 

^^f\jf\jmm<t 

LU 

-^— ^<r>r«*-r-< 

UJ 

Luoro 

CO 

•  •  •s: 

CD 

•   •  'S 

OD 

•  .  •  •  •  's: 

CO 

SL 

^ 

OQ.UJ 

2: 

•m^ 

s 

•_« 

2: 

•.^ 

z 

«^ 

CO 

LU 

> 

D 

Z3 

=> 

D 

< 

QC 

Z 

z 

z 

z 

1- 

42 


< 


LU 
<UJ»-' 

a< 
00  2: 


m 
o 


o 


00 


o 
o 

in 

m 


in 
O 


CO 

in 
o 


m 

o 

o 


^^ 

1 

mcxj^fO 

(\irO«^rO 

(NJr^CNJOI^^f^i 

ininininininvi- 

H-t-o: 

OCOfMO 

0000 

C\i(\|fM(N^-*>4- 

1    1    1    1    t    1    1 

(>0l/^< 

^^(\J^ 

0000 

0000000 

0000000 

<uu> 

0000 

OCOO 

0000000 

F^  _4  ,—1  .-4  _4  #-4  P-4 

LU 

•    •    •    • 

•   •    •   • 

-J 

0 

z: 

O'-^'^O 

0 

r^a^pw>j- 

>o«^  N}"sO'-^or«- 

C 

rOvj-sOfvjvOin^ 

< 

'^rsjsl'O 

0 

>o^-^-^ 

0 

r««"r~p*-inOm>^ 

0 

coaOvOr-in^-.t 

LU 

in 

r> — OLH— ^ 

0 

CT^O0^>^ 

0 

CO  00  00  00  0^  00-^ 

0 

CT»  <y.  cr>  0^  0^  cr>  (N 

S 

(\j 

•  •  •  t 

f-4 

•  •  •  • 

1— 1 

ininvOvOP-r-oj 

f— 4 

-^-4(\itNromo 

t* 

00 

•  • 

in 

•• 

0 

•  • 

^ 

X 

Q 

(^ 

a 

•-4 

0 

r* 

0 

r- 

< 

LU 

(NJ 

111 

0 

LU 

0 

LU 

<J- 

00 

s: 

1- 

r^ 

h- 

^-4 

H- 

■4- 

K- 

c 

1— 

< 

• 

< 

• 

< 

• 

< 

• 

■z 

a: 

a: 

CC 

CC 

LU 

LU 

1^ 

UJ 

0 

LU 

CD 

UJ 

o^ 

ZOOZ 

Z 

00 

Z 

>t 

2: 

00 

2 

0 

Ou. 

I"-" 

LU 

in 

LU 

0 

LU 

0 

LU 

0 

SH 

•s: 

0 

0 

0 

0 

0 

0 

0 

0 

< 

• 

• 

• 

• 

u_s: 

(•) 

00 

00 

00 

0 

o«- 

1 

-J 

(Njmincr 

^ 

^>t>3->t 

-1 

min(T>r*~^in^^ 

-J 

mmir»inmLnNi- 

0 

i-a: 

< 

Of*-om 

< 

0000 

< 

(^J  CM  <M  ^4  ■— •  ^^in 

< 

1   1    1   1    1    1    1 

f— 1 

CoO< 

2' 

^.-4(NJC\J 

^ 

0000 

2: 

0000000 

Z 

0000000 

auj> 

0 

0000 

0 

0000 

0 

0000000 

0 

•-4  ,^ —4  .^  ^^  r-4  •— 1 

II 

X 

1- 

Hi4 

CO 

•  •  •  • 

00 

•   •    •   • 

»-4 
00 

•  •••••• 

00 

< 

UJ 

z 

--^Nlrorsi 

Of^^vOf^ 

a*fnc\ir-oocr 

^r^vO-^ocT*-^ 

LL 

S 

< 

U- 

sO»^in>0 

LL 

ooin^o^ 

LL 

a^inOco<f  rvjm 

u. 

cocor*-r»--oin(r( 

— i 

LU 

O 

00^00 

a 

o^ocrm 

O 

CO(T<7>(T'<J*Of\j 

a 

0^  0^  ON  OCT^  (>  Ovj 

< 

2 

rsirsjrocM 

-Hvr  f^o 

ininsO-or-r-^ 

'-»'-4<Mr\jromO 

OC 

•  •   •   • 

at: 

•  •  •  • 

on 

•  •••••• 

OC 

LU 

LU 

LU 

LU 

CQ 

0^ 

CO 

00 

CO 

00 

CO 

0 

X 

■s: 

^^ 

2: 

CVJ 

2: 

m 

s: 

-0 

Q 

< 

D 

sO 

=3 

00 

z> 

^ 

3 

0 

0 

2: 

z: 

>o 

2 

0 

z 

sr 

z 

0 

0 

I 

• 

• 

• 

• 

»-*iy. 

) 

f^ 

0 

vO 

0 

-JLUZ 

co 

CO 

CNJ 

1— 1 

UJt- 

•  f^ 

m 

0 

0 

CNJ 

i«i<s: 

m 

0 

ro 

0 

>o 

-^ 

«o 

0 

►-•s 

• 

• 

• 

• 

-it-" 

(- 

•  • 

r-r^coin 

•  • 

'^focvjro 

t« 

coin— 4>3-inf>-o 

•  • 

sf  in>^-4inmm 

2: 00  a: 

00 

OOv^nOOO 

t/1 

0000 

00 

(NCNifNCNJCVJ—lf^ 

00 

1 1 101 10 

:3uj< 

CC 

0—H^-4»-< 

QC 

0000 

CC 

0000000 

OC 

0000000 

3: 

> 

LU 

0000 

LU 

0000 

UJ 

0000000 

UJ 

— 4  p— 1  ,-4  0 --^  — <  0 

H^ 

> 

•    •    •   • 

> 

•  •  •  • 

> 

> 

•          • 

X 

»-^ 

^■4 

►— • 

t—t 

< 

z 

LU 

m^vOO 

LU 

omino 

UJ 

r^or*-<vjp^<f  0^ 

UJ 

-4"-4Ov0fM^f^ 

s 

< 

0 

OvfCvjO 

0 

co-J-'>in 

0 

sO  nJ"  CO  l*~  (*~  — ^  r~- 

0 

--^  0  r»- ^- — 4  r-t —4 

LU 

UJ 

0000  CO 

LU 

(T-O^oom 

UJ 

0  o>a^  CO  00  0(\i 

LU 

-^^ooooo 

s 

u. 

•    •    •    • 

U- 

•  •  •  • 

CC 
u. 

ininvOvOf^f»-<N 

LL 

<M(\jmm<f-^o 
•  •••••• 

a: 

a 

0 

0 

a 

UJ 

QC 

<•» 

^•t 

—^ 

«« 

>rQO 

en 

OOOLU 

cn 

OOOLU 

CC 

(J^C^  O^HNCTO^UJ 

CC 

O'^OOOOUJ 

i-.Oh- 

UJ 

cNm«r< 

UJ 

fMinr-< 

LU 

ininvOvor^r-<i 

LU 

(\jf\jrnrOvrv*"< 

UJQ^O 

03 

•    •   "Z 

CO 

•   •  •2: 

CO 

.  .   •  .  .   .^ 

CQ 

«     •     •     •     •     s^ 

OQ-LU 

S 

a^ 

2: 

«« 

2: 

*^ 

2: 

■^ 

LU 

> 

0 

3 

Z3 

r? 

CC 

z 

z 

-z. 

z 

LU 


COLU 
<CC 
CO  ^^ 

01- 
ccz 

Q.UJ 


O-X 
UJH- 

CCCC 
LULU 
l-> 

za 
o 

l^LU 
UJI— 
>Z) 

ujs: 

LUO 

LU 

u-ac 
a< 

0000 

LULU 
H-l- 
<< 


0000 

LULU 

ZQC-. 

00    • 

occc 

lUCCCD 

CJUJl— 

z    o 

<UJLU 

<_J> 
>o»- 

OOh- I 
QC0_I 
Z<>-t 

<       CO 

Z< 

z<a3 

<UJO 

uj2:q: 

2:  — Q. 


in 

LU 

CQ 

< 
I- 


43 


00 

f— LUH- 

_lOt- 

00  00 

LU 


OOOLU 

clus: 

is:-* 

uuzoo 

Z       LU 


c 


m 

• 
rooD 
com 


coo  I  o 

•    #0    • 

>roo    o 
o    m 


«oooo 

>^f-tcoo 


•   • 


•  •  •  • 

OrOsOsO 


moo     -t'QOcj^oo 


(7^ 

in 

r-l(VJ 

m 


ir\     mo 

inrsiino 

•  •  •   • 

cMtn     in 


cr<f    in>r    o 


00  r^ 

00-4- 


CO>t 
0^03 


•  •  •   • 

NCr-ir\^o 

C0-4-OO 


0f\i<^fvj 
•    •    •    • 

ocncor- 


LU  O 
fvj  LU 
►-•UJI— 

oox< 
I- ex 

Z       LU 

aoz 

•-•ZLU 

<cX 

_)<00 
15  Q I 

oaz 

CLOO 


o 

OoO 

ZOlu 
15X1- 

r— < 
•--is: 

XLU*-" 

S>-oo 

_JLU 


CO<N 

00  U^ 

<\1 


rovj-om 


ojoo     >i- 


mo^coin 


i-trvj     occMinvo 
p^O     (^ao^^ooo 


m>f 


-•o 

0(^ 

com 


mr>~-Ovr 
•  •  •  • 

r-o<Nro 

^^m>— 'CM 


_l>00 

OQO 

i-<LU 
00  (-OC 
33  UJ 
UQlCQ 

<s:2: 

002 


II 

< 


LU 

O 


LU 

u 


<cc    <tce:zx 

LU<       LU<'-'< 
HI 

< 


Q 

«i« 

LU 

1- 

< 

Qc     a: 

LU      o 

Z      1- 

LU      O 

Ooouj 

a:> 

tOLU 

_i>a3 

<<-iO 

o 

ZLUQC 

<N 

OOO. 

• 

•— )UJ 

>«. 

ooctoi 

in 

LU 

^^ 

o^a:> 

• 

LUUJt-^ 

*s, 

CQCOUU 

O 

s:5:u 

OfO--* 

":!5--)uj 

o 

• 

Z^CC 

^^ 

It 

II 

II 

1-4 

»— 1 

z:*£Q. 

z:ij:a. 

LU 
O 


LU 
O 


<  < 

^—      21  — 
<iaL     <a:3x 

LU<       LU<'-»< 

LU 

< 


o 
•4- 


in 


omo 
o  m 
o  • 
•—I 

II 
II  II 

•—4 


LU 

o 


LU 
O 


<  < 

<a.    <a:2x 

LU<       LU<«-i< 

2:>    s>s:2: 

LU 
< 


in 

m 


in 


LU 


LU 

o 


<a:    <a:zx 

UJ<       UJ<'->< 

s>    s>2:2: 

LU 

< 


CM 

"s. 

in 


oo 


Z^Q. 


O  OO 
O  -^>t 
O        •    • 


II   II 


LULU 

u.a:x 

OOOOLJ 
LULUH- 

H-(— 

5:5:0 


O0  0O< 
LULU -J 

ZQia. 

000 

0:0. 

UJQC 
OLU_J 

2    < 

<IUJZ 
•-•l-O 

<_joo 
>a 

OOQ 

QCQLU 

2:<i- 
<    < 


2:<H-« 

<UJI— 
LUSOO 


CO 


44 


II 

< 


(•)UJ 

<<3: 

LU3HH 

LU 


U>       I/) 

Q2:< 

OLUZ 

XS-' 

LUZOO 
Z       LU 


Q 

XOUJ 

rjxi- 

XLU'-' 


Q 
LU 

I— 
< 

UJ 


O 


LU       O 
OOOUJ 

00  uu 

_J>CQ 
<»-'0 

ZLua: 

>-4LU 

LU 
CUCO 
UJLU>-i 
mcQLU 

2:2:0 

-5:duj 


z:^Q. 


(\J 

00     ir*o 

^NO>oro 

r*-^ 

v^>oinf-t 

nO 

— 4in>fO 

>t 

CNJCNJ 

1  0 

vO>ttMf-H 

r-vO 

o-i  1  a^ 

CD>0 

crcD  1  -^ 

• 

•  •o  • 

•    •    1 

•  • 

•  • 

•  •o  • 

•    • 

•  «o  • 

rOvO 

cm^4in 

^rvj 

^xMTirn 

oco 

vj-rvjr-^in 

■OfvJ 

inr-— tvO 

— ~ 

>4-ir» 

(MOO 

0 

-*co 

croN 

in 

(^(\J 

'-*         r-4 

ON>r 

—4     ,-t 

•         • 

.-4 

0 

CM 

cr>t 

a^ 

>— ( 

0^ 

LU      0 

m 

m 

a>r-t 

ON  SIZ 
G  THE 
NERATE 

00 

-^m 

0 

in    '-'.-^ 

O^f 

OOO"-* 

in 

— 4i— irnro 

1— t^U-l 

crin 

QOLnoo 

r^oo^o 

p«-— 4 

ino  •■o 

in  in 

>to  1  r^ 

(—•-■CD 

•   • 

•  • 

•    • 

•  •  ( 

•  • 

•    • 

•    "O    • 

•   • 

•  •  0  • 

<a: 

sj-rvj 

(NJvJ-OO 

in^^ 

<h^>0<f 

oin 

.ntn     in 

'-^<T> 

C7^fn.-40 

_j<(/) 

f\j-< 

f-4 

-«ir> 

com 

vO 

o>^ 

—4     ^^ 

QNin 

>t       fO 

3CL-I 

o.-^ 

1-^ 

>-> 

-^ 

c^ 

Q.2:< 

cr-* 

^^ 

NAL  PO 

BY  CO 

F  SIGN 

cr^ 

OCCvOf*- 

o^inr^cD 

vTO 

vO^>j-co 

r^ 

o>tino 

OQC 

vom 

>^ir>om 

in 

-Hor-cD 

ino 

>l--^.-tO 

mo 

CMOCfM 

•-•UJ 

•   • 

•  • 

•    t 

• 

•  •  1 

1  • 

•  • 

•  •  •  • 

•  • 

•    •    •    t 

(/>i-a 

>TCr 

CNiro 

0 

ir\c\i 

in— 4iriso 

cr-H 

vj--^     in 

r^m 

>r(Nj     in 

Z)U-i 

rg 

^-* 

inr~ 
in 

(N4 

crm 

^     f-i 

crrg 

^^         v-H 

OF  TOTAL 
ARE  COMP 
THE  NUMB 

LU 

UJ 

LU 

UJ 

LU 

UJ 

UJ 

LU 

OOOOLJ 

0 

0 

0 

0 

0 

0 

0 

0 

LULUI— 

2 

■ZL 

z 

Z 

z 

^ 

z 

Z 

H-t- 

< 

< 

< 

< 

< 

< 

< 

< 

<<z 

Zhh 

Z« 

Zn- 

z— 

z— 

Z"- 

z— 

z— 

2:2:0 

<a: 

<a:zx 

<a: 

<QiZX 

<a: 

<ct:zx 

<a: 

<aiZX 

•— ••— •►-^ 

UJ< 

UJ<»-'< 

UJ< 

UJ<— •< 

ijj< 

UJ<»-i< 

UJ< 

uu<«->< 

t-l-l- 

2:> 

2:>3:2: 

2:> 

z>2:2: 

2:> 

2:>3:2: 

S> 

z>2:s 

t/5oO< 

, 

•at 

.m, 

.^ 

LULU— 1 

UJ 

UJ 

1 

LU 

1 

XI 

■^ 

■ 

< 

< 

< 

< 

za:cL 

1 

£ 

Z 

£ 

z 

000 

Csl 

• 

in 

• 

D  VARIANCE 
BSOLUTE  ERR 
ED  SIGNAL  P 

■*~ 

V. 

•N 

Z<l- 

fO 

ro 

r- 

tn 

<    < 

h- 

h- 

(M 

'*• 

Z2: 

• 

• 

• 

• 

Z<'- 

•s. 

>* 

V. 

"s. 

■cJUJI— 

ir\ 

•^ 

CO^O 

oom 

Lus:</i 

>«• 

>0 

— irn 

^r- 

S^UJ 

• 

• 

•  • 

•  • 

>» 

om"*s 

>v^ 

v^^v 

00 

a 

1     in 

xo 

) 

O^OCO  ro 

• 

<-t 

0 

i     in 

0^'-^<^ 

( 

0     — <r>- 

f^ 

1 

r\rr\    • 

0 

• 

0 

n      •  • 

1 

!N 

r-{ 

1 

r— 1 

— 1 

LU 

II 

II 

11 

II 

~i 

II   II 

II 

II 

II      II 

II  II 

CD 

•— 1 

1--4 

1— 1 

»->4 

< 

Z:i£Q- 

Zi»i:Q. 

z^o. 

Z^CL 

H- 

45 


t-0 

miLi 

CM 

r~     ino 

oir\>^(M 

CM 

ooincr 

iTi     mcT 

f-LUI— 

m 

vtco 

1  0 

m 

mm  1  (Nj 

vor^ 

or-  1  0 

>tCNJ-40 

ooQc:< 

• 

•    #0    • 

• 

•   #0  • 

•  • 

t  •c   • 

•    •     •    • 

<<s: 

fvjm 

c<\i—*ir\ 

<Mir\ 

cMoo— <rg 

0 

^rn 

0-^ 

om^oo 

.^ 

UJZ)H-. 

>*Tn 

CNJr^ 

r»- 

om 

-41^       >!• 

0 

Or-* 

>OC\l       CNJ 

•       • 

_JOI- 

00 

r- 

^4 

CCM 

r— • 

000 

-^         »-4 

LU       Q 

oOtO 

t— 4 

r-t 

^4 

Ov^ 

^4 

rvl      LU 

LU 

t— t 

N    SI 

THE 

ERAT 

LL       t^ 

a02 

OOOLU 

-H 

om 

0 

>l-^Of\j 

or- 

>0(MO>1- 

-^     ir\r- 

>-'2uj 

^-t- 

^0(\J 

cOroOO 

-H 

•»-o^oo^ 

c-rvj 

aom   Tn 

Nj-(NJ(MrO 

f-«0 

QZ< 

•    • 

•    • 

•  • 

• 

•   •    •   • 

•  • 

•  •o  « 

•  •  •  • 

<QC 

oujs: 

r*-<\j 

NO(Niom 

-<o 

cNjr^     -4 

0-^ 

m 

00 

C0-4-— «<NJ 

_j<oo 

xs— 

OJ^ 

h- 

0 

or- 

-40    m 

0 

0<N 

>tm     sf 

3Q 1 

l-OH- 

•-4 

ocsj 

ft 

fi 

O-O 

CM       ^ 

asK 

LUSIOO 

<-i 

om 

•-4 

002 

X       lU 

^^ 

Q-OO 
-J><yi 

Q 

<co 

OoO 

2      LL 

SOLU 

on 

O00v*"v0 

moir\o 

cm 

Of\l— "00 

m     r-m 

OQO 

3XH- 

«r<\i 

>ocrooo 

0 

(M<\j-^>0 

00 

-hOOO^ 

oDmvrico 

«uj 

s:-.< 

•  • 

•  • 

•  • 

• 

•  •  •  • 

•  • 

•  •  •  « 

•  •  •  • 

LOI— Qc: 

—  -IS 

r-«tj 

nO<3 

>c 

'-^cr 

o^>r    CM 

0 

^vT 

—  O-^CNJ 

:3Lu 

xtu*-- 

rvj^ 

f*- 

>t 

om 

in    m 

0 

om 

om    0 

_IQ.CQ 

<:«it- 

—4 

Or-t 

^^ 

croo 

f*m     (M 

<2:2: 

2:  — 00 

v-4 

a<\i 

(\j 

I-03 

-JUJ 

C02 

o 

LULU 

o 

u_a:x 

r-i 

C<l- 

II 

LU 

LU 

UJ 

LU 

UJ 

lU 

UJ 

LU 

ooooo 

0 

0 

0 

0 

0 

0 

0 

0 

LULUI— 

< 

2 

2 

2 

2 

2 

2 

2 

2 

l-H- 

u. 

< 

< 

< 

< 

< 

< 

< 

< 

<<2 

^ 

2— 

2-- 

2>^ 

2>^ 

2-i 

2h^ 

2^ 

2— 

3:5:0 

< 

<QC 

<a:2X 

<Qc: 

<Qt:2X 

<a: 

<a:2X 

<a: 

<q:2x 

1      II      11—4 

UJ< 

LU<>-i< 

UJ< 

UJ<t-i< 

UJ< 

UJ<>-.< 

UJ< 

LU<<-'< 

1— 1— 1— 

:^> 

2:>s:e 

s> 

s>2:3: 

2:> 

2:>3:s: 

2:> 

s>sx 

!/)U1< 

. 

— » 

— « 

>« 

LULU -J 

1 

u 

LU 

LU 

1 

iXI 

:d 

< 

< 

< 

< 

20:0. 

z: 

z 

z 

£ 

aoo 

Q 

« 

<m^ 

^ 

«» 

CCQ. 

LU 

LUC^ 

f- 

OUJ_J 

< 

2      < 

oc     cc 

<UJ2 

uj     0 

H^l-O 

2!      1- 

airs— ' 

LU       0 

x^ 

V. 

<_JOO 

OOOLU 

0 

0 

>o 

0C> 

nO 

m 

oOQ 

1/1  LU 

• 

• 

QCQUJ 

_J>CD 

>>» 

■N 

2<l- 

<HHa 

0 

0* 

0 

0 

<      < 

21x10: 

-4- 

r- 

0 

m 

22 

OOQ. 

• 

• 

• 

• 

2<l  — 

H-iLU 

*>^ 

- 

-^ 

•*» 

*v 

V. 

<UJI— 

V^Q^QC 

0 

0 

(ra> 

00 

luSlo 

LU 

fO 

if\ 

inr- 

(NJ>t 

2:-*uj 

a:cc> 

• 

• 

«  • 

•     • 

LUUJi-i 

>* 

»s. 

^v. 

OvO>s>v 

CQCDLU 

0 

omo 

crc7> 

0    00 

• 

2: 3:0 

«NJ 

0 

(N 

O^omr- 

0      CMvf 

00 

~5-DLU 

mm  • 

0 

• 

0 

•  • 

0         •    • 

ZZCC 

( 

11 

-^ 

1 

II 

r-4 

II 

>-4 

II 

LU 

_l 

II  It 

II 

II 

II 

II 

II     II 

03 

I—I 

1-4 

>-4 

h-t 

t—t 

< 

2:^0. 

'. 

Z^^Q. 

2i!:a. 

2i,iQ. 

2i<iQ- 

t— 

46 


MEAN  ABSOLUTE  ERROR  SCORES 
ON  ESTIMATES  OF  RADIO  INTERCEPT  PROBABILITIES 


Ze(mae) 

ZVar  (MAE) 

Maximum 
Likelihood 
Estimates 

Method  of 

Moments 
Estimates 

Least 

Squares 

Estimates 

Alpha  =  1 

1.5272 
.0611 

1.8873 
.0993 

1.7616 
.3255 

Alpha  =  10 

ZE(MAE) 
ZVar(MAE) 

.5904 
.0229 

.5684 
.0237 

.6677 
.0996 

Alpha  =  100 

ZE(MAE) 
ZVar(MAE) 

.6046 
.0261 

.5822 
.0295 

.5905 
.0449 

MEAN  ABSOLUTE  ERROR  SCORES 
ON  ESTIMATES  OF  TOTAL  SIGNAL  POPULATION  SIZE 


1 

rE(MAE) 
i:Var(MAE) 

Maximum 
Likelihood 
Estimates 

Method  of 

Moments 
Estimates 

Least 

Squares 

Estimates 

Alpha  = 

2241.54 
4591.70 

2787.95 
4465.26 

2115.60 
14003.57 

Alpha  = 

10 

He  (MAE) 
ZVar(MAE) 

66.34 
598.71 

102.47 
1217.23 

121.84 
4107.67 

Alpha  = 

100 

rE(MAE) 
ZVar(MAE) 

117.85 
2461.50 

68.81 

1437.97 

94.11 
2915.05 

Table  9«   Mean  Absolute  Error  Scores 
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VI.   SUMMARY  AND  RECOMMENDATIONS 

This  thesis  has  presented  a  development  of  various 
estimators  which  can  be  used  to  estimate  the  total  number 
of  signals  passing  through  an  acquisition  system  given 
only  a  portion  were  detected.   Likewise,  estimators  were 
found  for  estimating  the  intercept  probabilities  for  each 
receiver  in  the  system.   These  estimators  were  used  in  the 
context  of  a  model  developed  to  represent  the  signal  de- 
tection process.   The  model  suggested  is  the  foundation 
for  a  simulation  conducted  over  a  variety  of  conditions 
including  receiver  and  signal  characteristics  as  well  as 
transmitter  activity.   The  simulation  results  provided  some 
general  insight  into  the  quality  of  the  estimators  devel- 
oped and  their  behavior  over  varying  conditions.   The 
question  of  dependence  between  receivers  was  briefly  ad- 
dressed and  it  was  shown  that  as  dependency  increased,  the 
quality  of  the  estimates  decreased. 

The  work  presented  here  is  not  viewed  as  a  final  solution 
to  the  problem.   The  model  used  was  designed  for  flexibility 
and  it  would  be  a  simple  matter  to  refine  and  expand  the 
detection  process  used  within  this  report.   The  simulation 
conducted  was  sufficient  for  validating  the  model  and  ob- 
taining some  initial  insight  into  the  quality  of  the  esti- 
mators but  was  not  adequate  for  making  conclusive  claims 
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about  them.   It  is  hoped  that  this  thesis  may  stimulate 
others  into  continuing  work  on  this  subject.   In  particu- 
lar, it  is  suggested  that  a  complete  experiment  be  designed 
and  a  formal  data  analysis  of  the  simulation  results  be 
conducted  to  determine  which  method  of  estimation  is  opti- 
mal.  It  would  equally  be  interesting  if  someone  with  an 
electronics  background  could  incorporate  into  the  model 
additional  parameters  or  functional  relationships  bringing 
in  some  hardware  considerations  or  radiowave  characteristics. 
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APPENDIX  A 
SIMULATION  PACKAGE  CHARACTERISTICS  AND  REQUIREMENTS 

The  simulation  discussed  in  section  IV  is  designed  to 
minimize  user  interaction.   The  user  must  decide  what  is 
desired  to  be  accomplished  by  the  simulation  and  modify 
the  main  routine  and  output  routine  accordingly.   The 
material  discussed  in  this  appendix  suggests  simple  in- 
structions on  how  to  use  the  FORTRAN  simulation  package 
provided  with  this  study.   A  complete  source  listing  of 
the  FORTRAN  code  is  located  at  the  end  of  this  appendix. 

A.   CHARACTERISTICS 

As  currently  designed,  the  simulation  is  dimensioned 
to  handle  an  acquisition  system  of  up  to  ten  receivers. 
The  total  number  of  signals  which  can  be  generated  in  any 
one  replication  is  99,999  ,  limited  only  by  the  input  for- 
mat statement  allowing  five  digits.   Similarly,  the  random 
number  generator  seed  is  formatted  for  up  to  five  digits. 
To  modify  the  simulation  to  handle  a  larger  acquisition 
system  or  increase  the  number  of  signals  desired  to  be 
generated  is  a  simple  matter  of  increasing  the  dimension- 
ality of  the  arrays  and  enlarging  input  formats. 
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B.  METHOD  SELECTION 

The  user  must  determine  which  one  or  more  methods  of 
estimation  to  be  performed.   Should  only  one  method  of 
estimation  be  desired,  that  method  is  requested  through  a 
coded  input  parameter  in  the  data  base  as  follows: 
Maximum  Likelihood. .. .METHOD  =  1 

Method  of  Moments METHOD  =  2 

Least  Squares METHOD  =  3  . 

If  more  than  one  method  is  desired,  the  user  should  provide 
the  lowest  coded  input  parameter  in  the  data  base  and 
establish  the  appropriate  looping  in  the  main  routine.   The 
loop  established  in  the  source  listing  at  the  end  of  this 
appendix  provides  for  all  three  methods  to  be  applied  to  a 
common  signal  data  set  created  by  subroutine  GNRATE. 

C.  REQUIREMENTS  WITH  THE  USE  OF  GRG 

If  the  user  specifies  the  maximum  likelihood  method  of 
estimation  to  be  used,  the  user  supplied  subroutine  GCOMP 
must  be  included  in  the  source  listing.   This  subroutine 
contains  the  objective  function  to  which  the  generalized 
reduced  gradient  (GRG)  routine  attempts  to  maximize.   (In 
actuality,  the  GRG  routine  minimizes  an  objective  function, 
thus,  to  maximize  the  log-likelihood  function  it  is  neces- 
sary to  minimize  the  negative  of  the  objective  function.) 
Subroutine  GCOMP  contained  in  the  source  listing  provided 
is  general  in  nature  and  accurately  represents  the  log- 
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likelihood  function  discussed  in  section  III  for  any 
k-receiver  system.   No  user  modifications  to  this  routine 
are  necessary  for  systems  of  ten  receivers  or  less. 

Each  time  the  maximum  likelihood  method  is  used  during 
the  course  of  a  simulation,  the  GRG  routine  is  called. 
With  each  call  to  subroutine  GRG,  it  is  necessary  to  pro- 
vide a  special  input  data  base  to  support  the  optimization. 
This  data  base  is  read  by  library  routine  DATAIN,  and  is 
supplementary  to  the  initial  data  base  established  for  the 
simulation. 

D.   DATA  INPUT 

Six  data  cards  initialize  the  simulation.   An  addition- 
al set  of  data  cards  are  necessary  for  each  call  to  sub- 
routine GRG.   The  size  of  the  data  set  required  for  GRG 
is  related  to  the  number  of  receivers.   Shown  at  Figure  5 
is  a  sample  data  set  for  a  three  receiver  system.   The 
data  is  preceeded  by  a  data  section  number  and  followed  by 
the  input  format.   Below,  is  a  description  of  each  data 
entry  by  data  section  number. 
Data  Sctn  Number        Data  Elements  and  Description 

1  Random  number  generator  seed  (read  once) 

2  Number  of  signals  to  be  generated. 

3  Number  of  receivers  in  the  system. 

4  Input  receiver  intercept  probability 
vector. 
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5  Value  of  a^ha  used  in  generating  B  (  oc  ,  1 ) 
variates. 

6  Method  of  analysis  to  be  used. 

7  Problem  name.   Any  combination  of  80 
alphanumeric  characters. 

8  Number  of  receivers  (values  of  rr.  to 
be  estimated)  followed  by  a  '  1  '  arid 
•0',  the  number  of  equality  and  in- 
equality constraints  in  the  maximiza- 
tion. 

9  Number  of  variables  with  finite  lower 
bounds  (equal  to  the  number  of  receivers). 

10  There  should  be  k  cards  each  containing 
a  pair  of  numbers.   The  first  number  is 
the  index  of  the  variable  in  9  above 
followed  by  its  lower  bound.   In  this 
simulation  the  lower  bound  is  set  at 
.0005  . 

1 1  Number  of  variables  with  finite  upper 
bounds  (again,  equal  to  the  number  of 
receivers) . 

12  There  should  be  k  cards  each  containing 
a  pair  of  numbers.   The  first  number  is 
the  index  of  the  variable  in  1 1  above 
followed  by  its  upper  bound.   In  this 
simulation  the  upper  bound  is  set  at 
.9999. 

13  Number  of  inequality  constraints  having 
finite  upper  bounds.   Enter  0. 

14  Initial  values  for  TT. .   Enter  .50  for 

t.  1 

each. 

15  Tolerance  value  when  certain  iterative 
processes  should  stop.   Default  value 
is  zero. 

16  Limits  on  the  upper  bound  of  allowed 
iterations.   Default  value  is  zero, 

17  Specification  on  the  desired  amount  of 
output.   Zero  is  the  default  value  and 
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a  value  of  one  allows  the  user  to  in- 
crease or  decrease  output.   A  value  of 
one  is  used  to  suppress  output  in  this 
simulation. 

18  A  pair  of  zero  values  effects  the  sup- 
pression of  output. 

19  Anything  but  'QUAD'  will  assure  the  use 
of  tangent  vector  extrapolation  for  est- 
imating initial  values  of  basic  variables. 

20  If  the  user  does  not  wish  to  partially 
or  completely  specify  an  initial  basis, 
enter  a  zero  on  this  card. 

For  a  more  detailed  discussion  on  GRG  refer  to  a  GRG  user's 

guide  (i.e.  see  Lasdon,  1975). 

E.   OUTPUT  SELECTION 

Two  forms  of  subroutine  OUTPUT  are  provided  with  the 

source  listing.   The  first  form  is  used  when  one  or  more 

environments  are  specified  and  replicated  once  each.   This 

form  would  typically  be  used  with  actual  field  data.   The 

second  form  of  subroutine  OUTPUT  is  used  when  it  is  desired 

to  replicate  one  environment  a  number  of  times  to  allow 

for  a  statistical  analysis  of  the  estimators  fr.  and  's, 

^  1 

The  user  need  only  to  decide  which  form  of  the  output  is 
applicable  to  the  simulation  being  conducted  and  insert 
the  appropriate  listing. 
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Data 
Section 

Number Sample  Data Format 

Card  Column 
12345678911111111112222222222333333  33  33 
012345678  901234567890123456789 


1  21215  15 

2  10000  15 

3  3  15 

4  .60  .70   .80                            10F5.2 

5  100.  F5.1 

6  1  15 

7  Problem  name.   Any  80  Alphaniimerics .  20A4 

8  3  10                           315 

9  3  15 

10  1  .0005                       I5,5X,E10.4 

2  .0005 

3  .0005 

11  3  15 

12  1  .9999                       I5,5X,E10.4 

2  .9999 

3  .9999 

13  0  15 

14  .50  .50        .50              8E10.4 

15  0  15 

16  0  15 

17  1  15 

18  0  0                                 215 

19  0  A4 

20  0  15 


Figure  5   •  Sample  Data  Set  for  a  3-Receiver  System 
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APPENDIX  B 

LIST  OF  SYMBOLS 
(alphabetically) 


A:   the  event  (Z^^O) 

B:   an  index  of  the  elements  in  the  vector  N 

I^ :   number  of  data  vectors  2  for  which  z,  =  j 

K  =  t.'/(n-:...n  ,   ) 
^      2^-1 

k:   number  of  receivers 

L(s,p):   likelihood  of  N  at  n 

1.:   proportion  of  signals  of  strength  V  that  receiver  i 
would  detect 

M.  :   niimber  of  signals  detected  by  receiver  i  (outcome  is 

m  :  ^.     .(number  of  signals  detected  simultaneously  by 
-'  receivers  i  and  j) 

N:   random  vector  with  outcome  n;  N /^/ M  ,   (s,p) 

2^-1 

n  =  (n  ,  n^  , . , . ,    n  ,   ):  vector  of  n  's  in  some  specific 
°   ^       2-1    order      ^ 

n  :   number  of  times  z  S  occurs 
z 

P  =  (P^/  Pi f • • . ,  P  v   ):   vector  of  p  's  in  same  order  as 

O      I  ^K  ^  r-  Z 

2  -1     for  n 


p   (j) :   mass  function  of  z 
'-  z 

qi  =  Pi/(1  -  P^) 
r  =  2^  -  1 


S:  sample  space  of  Z 
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s:   number  of  signals 

's,rf.  :  .estimates  of  s  and  ri.,    respectively 

T.  (v. )  =  Tt.  .  =  1.  -v. 

1  :     i:    1   3 

t:  number  of  signals  detected 
U:  uniform(0,1)  random  number 
v.:  strength  of  signal  j  (outcome  is  v.) 

Z  =  {Z^,...,    Z,  ) :   vector  of  Bernoulli  detection  or  non- 
detection  indicators,  for  a  given  signal, 
for  all  receivers 

^  z. :   number  of  receivers  which  detect  a  given 
signal 

Tf. .:   probability  receiver  i  detects  signal  j 

Tf.  =  E(T.  (V)  )  =1.  •  E(V) 
1       1         1 

«:   parameter  of  V.  where  V  .  r>-' Q{cx ,  ^) 


67 


LIST  OF  REFERENCES 


1.  Barr,  Donald  R.  (1981),  'Estimation  of  Sensor 
Detection  Probabilities  with  Data  from  Concurrent 
Sensors',  Naval  Postgraduate  School  Technical  Report 
NPS55-81-014. 

2.  Sanathanan,  Lalitha  (1972),  'Estimating  the  Size  of 

a  Multinomial  Population',  The  Annals  of  Mathematical 
Statistics,  43,  142  -  152. 

3.  Knorr,  Jeffrey  B.  (1979),  'A  Model  for  Estimating 
Acquisition  Receiving  System  Intercept  Probability', 
Naval  Postgraduate  School  Technical  Report 
NPS62-79-005,  29p. 

4.  Lasdon,  L. ,  A.  Waren,  A.  Jain,  and  M.  Ratner  (1975), 
'GRG   User's  Guide',  Cleveland  State  University 
Technical  Memorandiim  CIS  -  75  -  02. 


68 


INITIAL  DISTRIBUTION  LIST 


No.  Copies 


1 .  Defense  Technical  Information  Center         2 
Cameron  Station 

Alexandria,  Virginia  22314 

2.  Library,  Code  0142  2 
Naval  Postgraduate  School 

Monterey,  California  93940 

3.  Department  Chairman,  Code  55  1 
Department  of  Operations  Research 

Naval  Postgraduate  School 
Monterey,  California  93940 

4.  Professor  D.  R.  Barr,  Code  55Bn  10 
Naval  Postgraduate  School 

Monterey,  California  93940 

5.  Captain  David  S.  Hendrickx  10 
1 5  Roberts  Road 

Amherst,  New  Hampshire  0  3031 

6.  Professor  J.  B.  Knorr,  Code  6  2Ko  1 
Naval  Postgraduate  School 

Monterey,  California  93940 


69 


fii 


^Hd 


^i 


''k^ 


'''<?0 


^^   e 


'On 


^i 


sjf 


§n 


^1 


es 


Thesis 
H44355 
c.l 

194470 

Hendrickic 

An  evaluation  of 

estimators  for  receiver 
detection  probabilities 
and  unknown  signal  po-- 
pulation  size. 


thesH44355 

An  evaluation  of  estimators  for  receiver 


3  2768  000  99209  3       , 

DUDLEY  KNOX  LIBRARY        .  > 


't^SiSPSl 


■^s 


ai}0-'\t-' 


